https://www.rik-kisnah.ai/tags/hbm/Recent content in HBM on Rik Kisnah - BlogHugoenTue, 14 Sep 2021 09:00:00 -0700https://www.rik-kisnah.ai/teach/gpu-ai/why-gpus-for-ai/Tue, 14 Sep 2021 09:00:00 -0700https://www.rik-kisnah.ai/teach/gpu-ai/why-gpus-for-ai/A CPU is eight chefs who can cook anything. A GPU is ten thousand kids who can each only stir one pot, but all at the same time and all the same way. AI is mostly stirring pots.https://www.rik-kisnah.ai/teach/gpu-ai/gpu-memory-hierarchy/Tue, 12 Nov 2019 09:00:00 -0800https://www.rik-kisnah.ai/teach/gpu-ai/gpu-memory-hierarchy/Registers, shared memory, HBM, then the CPU across the bus. Each level is bigger and slower than the last by a lot. Most slow GPU code is fast GPU code waiting for the wrong level.