https://www.rik-kisnah.ai/tags/roce/Recent content in RoCE on Rik Kisnah - BlogHugoenTue, 15 Aug 2023 09:00:00 -0700https://www.rik-kisnah.ai/teach/gpu-ai/design-the-training-network/Tue, 15 Aug 2023 09:00:00 -0700https://www.rik-kisnah.ai/teach/gpu-ai/design-the-training-network/Two networks, not one. East-west is where GPUs talk to GPUs and must never drop a packet. North-south is everything else. Draw the rails, keep it lossless, and never let the two share a wire.https://www.rik-kisnah.ai/teach/gpu-ai/rdma-explained/Tue, 10 Mar 2020 09:00:00 -0800https://www.rik-kisnah.ai/teach/gpu-ai/rdma-explained/Normal networking hands every packet to the operating system, which copies it, thinks about it, and copies it again. RDMA lets one machine write straight into another machine’s memory with nobody in the middle. That is why GPU clusters use it.