CUDA on Rik Kisnah - Bloghttps://www.rik-kisnah.ai/tags/cuda/Recent content in CUDA on Rik Kisnah - BlogHugoenTue, 12 Nov 2019 09:00:00 -0800The GPU Memory Hierarchyhttps://www.rik-kisnah.ai/teach/gpu-ai/gpu-memory-hierarchy/Tue, 12 Nov 2019 09:00:00 -0800https://www.rik-kisnah.ai/teach/gpu-ai/gpu-memory-hierarchy/Registers, shared memory, HBM, then the CPU across the bus. Each level is bigger and slower than the last by a lot. Most slow GPU code is fast GPU code waiting for the wrong level.