Vanishing Gradients

Episode 54: Scaling AI: From Colab to Clusters — A Practitioner’s Guide to Distributed Training and Inference

July 19th, 2025  |  Season 1  |  41 mins 17 secs

ai, compute, genai, llm

Colab is cozy. But production won’t fit on a single GPU. Zach Mueller leads Accelerate at Hugging Face and spends his days helping people go from solo scripts to scalable systems. In this episode, he joins me to demystify distributed training and inference — not just for research labs, but for any ML engineer trying to ship real software.

Episode 52: Why Most LLM Products Break at Retrieval (And How to Fix Them)

July 3rd, 2025  |  Season 1  |  28 mins 38 secs

ai, data science, genai, llms, machine learning

Most LLM-powered features do not break at the model. They break at the context. So how do you retrieve the right information to get useful results, even under vague or messy user queries?

In this episode, we hear from Eric Ma, who leads data science research in the Data Science and AI group at Moderna. He shares what it takes to move beyond toy demos and ship LLM features that actually help people do their jobs.

Episode 47: The Great Pacific Garbage Patch of Code Slop with Joe Reis

April 7th, 2025  |  Season 1  |  1 hr 19 mins

ai, data science, genai, llms, machine learning, vibe coding

What if the cost of writing code dropped to zero — but the cost of understanding it skyrocketed?

In this episode, Hugo sits down with Joe Reis to unpack how AI tooling is reshaping the software development lifecycle — from experimentation and prototyping to deployment, maintainability, and everything in between.

Episode 46: Software Composition Is the New Vibe Coding

April 3rd, 2025  |  Season 1  |  1 hr 8 mins

ai, data science, genai, llms, machine learning, vibe coding

What if building software felt more like composing than coding?

In this episode, Hugo and Greg explore how LLMs are reshaping the way we think about software development—from deterministic programming to a more flexible, prompt-driven, and collaborative style of building. It’s not just hype or grift—it’s a real shift in how we express intent, reason about systems, and collaborate across roles.

Hugo speaks with Greg Ceccarelli—co-founder of SpecStory, former CPO at Pluralsight, and Director of Data Science at GitHub—about the rise of software composition and how it changes the way individuals and teams create with LLMs.

Episode 42: Learning, Teaching, and Building in the Age of AI

January 4th, 2025  |  Season 1  |  1 hr 20 mins

ai, data science, genai, llms, machine learning

The tables turn as Hugo sits down with Alex Andorra, host of Learning Bayesian Statistics. Hugo shares his journey from mathematics to AI, reflecting on how Bayesian inference shapes his approach to data science, teaching, and building AI-powered applications.

Episode 41: Beyond Prompt Engineering: Can AI Learn to Set Its Own Goals?

December 31st, 2024  |  Season 1  |  43 mins 51 secs

data science, genai, llms, machine learning

Hugo Bowne-Anderson hosts a panel discussion from the MLOps World and Generative AI Summit in Austin, exploring the long-term growth of AI by distinguishing real problem-solving from trend-based solutions. If you're navigating the evolving landscape of generative AI, productionizing models, or questioning the hype, this episode dives into the tough questions shaping the field.

Episode 38: The Art of Freelance AI Consulting and Products: Data, Dollars, and Deliverables

November 5th, 2024  |  Season 1  |  1 hr 23 mins

consulting, data science, genai, llms, machine learning

Hugo speaks with Jason Liu, an independent AI consultant with experience at Meta and Stitch Fix. At Stitch Fix, Jason developed impactful AI systems, like a $50 million product similarity search and the widely adopted Flight recommendation framework. Now, he helps startups and enterprises design and deploy production-level AI applications, with a focus on retrieval-augmented generation (RAG) and scalable solutions.

Episode 37: Prompt Engineering, Security in Generative AI, and the Future of AI Research Part 2

October 8th, 2024  |  Season 1  |  50 mins 36 secs

data science, genai, llms, machine learning, nlp, prompt engineering

Hugo speaks with three leading figures from the world of AI research: Sander Schulhoff, a recent University of Maryland graduate and lead contributor to the Learn Prompting initiative; Philip Resnik, professor at the University of Maryland, known for his pioneering work in computational linguistics; and Dennis Peskoff, a researcher from Princeton specializing in prompt engineering and its applications in the social sciences.

Episode 36: Prompt Engineering, Security in Generative AI, and the Future of AI Research Part 1

September 30th, 2024  |  Season 1  |  1 hr 3 mins

data science, genai, llms, machine learning, nlp, prompt engineering

Hugo speaks with three leading figures from the world of AI research: Sander Schulhoff, a recent University of Maryland graduate and lead contributor to the Learn Prompting initiative; Philip Resnik, professor at the University of Maryland, known for his pioneering work in computational linguistics; and Dennis Peskoff, a researcher from Princeton specializing in prompt engineering and its applications in the social sciences.

Episode 35: Open Science at NASA -- Measuring Impact and the Future of AI

September 19th, 2024  |  Season 1  |  58 mins 13 secs

data science, genai, llms, machine learning

Hugo speaks with Dr. Chelle Gentemann, Open Science Program Scientist for NASA’s Office of the Chief Science Data Officer, about NASA’s ambitious efforts to integrate AI across the research lifecycle. In this episode, we’ll dive deeper into how AI is transforming NASA’s approach to science, making data more accessible and advancing open science practices.