Metrics on Rik Kisnah - Bloghttps://www.rik-kisnah.ai/tags/metrics/Recent content in Metrics on Rik Kisnah - BlogHugoenTue, 14 Nov 2023 09:00:00 -0800Measure GPU Utilisation and MFUhttps://www.rik-kisnah.ai/teach/gpu-ai/measure-gpu-utilisation-and-mfu/Tue, 14 Nov 2023 09:00:00 -0800https://www.rik-kisnah.ai/teach/gpu-ai/measure-gpu-utilisation-and-mfu/‘GPU utilisation 100 percent’ can mean the chip is doing useful maths, or that one thread is spinning. Model FLOPs utilisation is the honest number: useful work divided by what the chip could do. Know how to compute it and what a good value is.