Rik Kisnah - Blog
Posts
About
Publications
Resume
Teach
MCP
github
linkedin
#Distributed Training
The Complete NCCL Reference Guide: Commands, Errors, and Troubleshooting for OCI GPU Infrastructure
Nov 15, 2025
The Complete NCCL Reference Guide: Commands, Errors, and Troubleshooting for OCI GPU Infrastructure
Straggler Detection in Training Jobs
Jan 16, 2024
Straggler Detection in Training Jobs
All-Reduce Explained
May 10, 2022
All-Reduce Explained
Checkpointing at Scale
Dec 7, 2021
Checkpointing at Scale
Data, Model, and Pipeline Parallelism
Sep 15, 2020
Data, Model, and Pipeline Parallelism