Rik Kisnah - Blog

#GPU

Attention Is All You Need — And All You Need to Know: An Infrastructure Engineer's Guide to the Paper That Built Your GPU Cluster

Attention Is All You Need — And All You Need to Know: An Infrastructure Engineer's Guide to the Paper That Built Your GPU Cluster

Design a Model Serving Platform with Versions and A/B Tests

Design a Model Serving Platform with Versions and A/B Tests

The Complete NCCL Reference Guide: Commands, Errors, and Troubleshooting for OCI GPU Infrastructure

The Complete NCCL Reference Guide: Commands, Errors, and Troubleshooting for OCI GPU Infrastructure

Design an Inference API

Design an Inference API

OCI Powers America's AI Future at NVIDIA GTC 2025: Supercomputers, AI Factories, and Strategic Leadership

OCI Powers America's AI Future at NVIDIA GTC 2025: Supercomputers, AI Factories, and Strategic Leadership

From First Principles to Zettascale: How OCI's GPU/RDMA Architecture Redefines AI Infrastructure

From First Principles to Zettascale: How OCI's GPU/RDMA Architecture Redefines AI Infrastructure

Mixture of Experts and All-to-All Traffic

Mixture of Experts and All-to-All Traffic

Continuous Batching for Inference

Continuous Batching for Inference

Size the KV Cache

Size the KV Cache

Power and Cooling for GPU Racks

Power and Cooling for GPU Racks