Vanishing Gradients
a data podcast with hugo bowne-anderson
Displaying all 2 Episode of Vanishing Gradients with the tag “llm”.
-
Episode 55: From Frittatas to Production LLMs: Breakfast at SciPy
August 13th, 2025 | 38 mins 8 secs
data science, generative ai, llm, machine learning, scipy
Traditional software expects 100% passing tests. In LLM-powered systems, that’s not just unrealistic — it’s a feature, not a bug. Eric Ma leads research data science in Moderna’s data science and AI group, and over breakfast at SciPy we explored why AI products break the old rules, what skills different personas bring (and miss), and how to keep systems alive after the launch hype fades.
-
Episode 54: Scaling AI: From Colab to Clusters — A Practitioner’s Guide to Distributed Training and Inference
July 19th, 2025 | Season 1 | 41 mins 17 secs
ai, compute, genai, llm
Colab is cozy. But production won’t fit on a single GPU. Zach Mueller leads Accelerate at Hugging Face and spends his days helping people go from solo scripts to scalable systems. In this episode, he joins me to demystify distributed training and inference — not just for research labs, but for any ML engineer trying to ship real software.