https://www.rik-kisnah.ai/tags/gpu/Recent content in GPU on Rik Kisnah - BlogHugoenSat, 28 Feb 2026 09:00:00 -0700https://www.rik-kisnah.ai/posts/attention-is-all-you-need-and-all-you-need-to-know/Sat, 28 Feb 2026 09:00:00 -0700https://www.rik-kisnah.ai/posts/attention-is-all-you-need-and-all-you-need-to-know/The 2017 Transformer paper replaced sequential processing with parallel attention and launched the GPU infrastructure boom. The same attention problem exists in your repository. Here is how to fix it.https://www.rik-kisnah.ai/posts/nccl-complete-reference-guide/Sat, 15 Nov 2025 00:00:00 -0700https://www.rik-kisnah.ai/posts/nccl-complete-reference-guide/Disclaimer: This article reflects my personal research and analysis based on publicly available information and is not representative of my employer’s official position. Executive Summary NCCL (NVIDIA Collective Communication Library) is the cornerstone of distributed GPU computing, enabling efficient communication between GPUs in multi-node clusters. This comprehensive guide provides every NCCL command, parameter, error message, and troubleshooting technique you need for successful deployment on Oracle Cloud Infrastructure (OCI). Table of Contents Why NCCL Exists Understanding Collective Communications NCCL Fundamentals Complete NCCL Commands Reference All NCCL Environment Variables NCCL Error Messages and Solutions OCI GPU-Specific Configurations Advanced Troubleshooting Scenarios Performance Tuning Reference Quick Reference Tables Why NCCL Exists The Distributed Training Challenge Modern AI models have grown exponentially in size and complexity.https://www.rik-kisnah.ai/posts/oci-nvidia-gtc-2025-ai-supercomputing/Wed, 29 Oct 2025 10:00:00 -0700https://www.rik-kisnah.ai/posts/oci-nvidia-gtc-2025-ai-supercomputing/Disclaimer: This article reflects my personal research and analysis based on publicly available information and is not representative of my employer’s official position. Highlights from NVIDIA GTC DC 2025: OCI at the Heart of the AI Revolution Oracle Cloud Infrastructure (OCI) demonstrated its central role in shaping the future of AI infrastructure at NVIDIA’s GTC conference in Washington, DC (October 28-29, 2025). The event showcased groundbreaking announcements, technical innovations, and strategic partnerships that position OCI as a cornerstone of America’s AI leadership.https://www.rik-kisnah.ai/posts/summary-gpu-oci-first-principles-blog/Sun, 26 Oct 2025 22:43:15 -0400https://www.rik-kisnah.ai/posts/summary-gpu-oci-first-principles-blog/Disclaimer: This article reflects my personal research and analysis based on publicly available information and is not representative of my employer’s official position. In the rapidly evolving landscape of AI infrastructure, one company has quietly revolutionized how we think about GPU computing at scale. Through a series of “First Principles” engineering blogs and groundbreaking deployments, Oracle Cloud Infrastructure (OCI) has demonstrated that starting from fundamental physics and systems design—rather than following industry conventions—can yield extraordinary results.