Engineering write-ups on AI/ML, LLM inference, and building production software
From 54GB to 15GB, from 0 to 600+ tokens/second — here's the real engineering story behind serving Google's MedGemma 27B on a single GPU.