Validation on Rik Kisnah - Bloghttps://www.rik-kisnah.ai/tags/validation/Recent content in Validation on Rik Kisnah - BlogHugoenTue, 09 Apr 2024 09:00:00 -0700Design a Burn-In Pipelinehttps://www.rik-kisnah.ai/teach/gpu-ai/design-a-burn-in-pipeline/Tue, 09 Apr 2024 09:00:00 -0700https://www.rik-kisnah.ai/teach/gpu-ai/design-a-burn-in-pipeline/Brand new hardware fails. Find the bad parts on your time, not the customer’s. Test one GPU, then one server, then one rack, then the whole cluster, with a gate at every step. Fail fast, log everything, never let a stage run without a stop rule.