Rik Kisnah - Blog

#LLM

Design a Token Usage and Limits Service

Design a Token Usage and Limits Service

Chat Is the Product. API Is the Contract. CLI Agents Are the Harness.

Chat Is the Product. API Is the Contract. CLI Agents Are the Harness.

A Short History of AI: From Greek Myths to Large Language Models

A Short History of AI: From Greek Myths to Large Language Models

Attention Is All You Need — And All You Need to Know: An Infrastructure Engineer's Guide to the Paper That Built Your GPU Cluster

Attention Is All You Need — And All You Need to Know: An Infrastructure Engineer's Guide to the Paper That Built Your GPU Cluster

How Large Language Models Actually Work

How Large Language Models Actually Work

Design an Inference API

Design an Inference API

Continuous Batching for Inference

Continuous Batching for Inference

Size the KV Cache

Size the KV Cache