Rollouts on Rik Kisnah - Bloghttps://www.rik-kisnah.ai/tags/rollouts/Recent content in Rollouts on Rik Kisnah - BlogHugoenTue, 17 Mar 2026 09:00:00 -0700Design Model Weight Distribution to a Thousand Hostshttps://www.rik-kisnah.ai/teach/gpu-ai/design-model-weight-distribution/Tue, 17 Mar 2026 09:00:00 -0700https://www.rik-kisnah.ai/teach/gpu-ai/design-model-weight-distribution/A 500 GB model sits in one repository behind a 10 Gbps link. A thousand GPU hosts need it, each with a 10 Gbps card, and a few of them will die while you copy. Say the lower bound, then design the swarm that gets close to it, then the part that actually matters in production: verifying every copy and never serving from a half-loaded host.