Topology on Rik Kisnah - Bloghttps://www.rik-kisnah.ai/tags/topology/Recent content in Topology on Rik Kisnah - BlogHugoenTue, 11 Oct 2022 09:00:00 -0700Design a Topology-Aware GPU Schedulerhttps://www.rik-kisnah.ai/teach/gpu-ai/design-a-topology-aware-gpu-scheduler/Tue, 11 Oct 2022 09:00:00 -0700https://www.rik-kisnah.ai/teach/gpu-ai/design-a-topology-aware-gpu-scheduler/Which GPUs a job lands on decides how fast it runs. A scheduler that hands out any free GPU is a scheduler that puts one job’s ring across three spines. Give it a map of the cluster and make it place jobs the way the network wants.