Vanishing Gradients
a data podcast with hugo bowne-anderson
Displaying 1 Episode of Vanishing Gradients with the tag “llm”.
-
Episode 54: Scaling AI: From Colab to Clusters — A Practitioner’s Guide to Distributed Training and Inference
July 19th, 2025 | Season 1 | 41 mins 17 secs
ai, compute, genai, llm
Colab is cozy. But production won’t fit on a single GPU. Zach Mueller leads Accelerate at Hugging Face and spends his days helping people go from solo scripts to scalable systems. In this episode, he joins me to demystify distributed training and inference — not just for research labs, but for any ML engineer trying to ship real software.