Vanishing Gradients
00:00:00
/
01:08:11

Episode 21: Deploying LLMs in Production: Lessons Learned

November 14th, 2023

Hugo speaks with Hamel Husain, a machine learning engineer who loves building machine learning infrastructure and tools 👷. Hamel leads and contributes to many popular open-source machine learning projects. He also has extensive experience (20+ years) as a machine learning engineer across various industries, including large tech companies like Airbnb and GitHub. At GitHub, he led CodeSearchNet, a large language model for semantic search that was a precursor to CoPilot. Hamel is the founder of Parlance-Labs, a research and consultancy focused on LLMs.

They talk about generative AI, large language models, the business value they can generate, and how to get started.

They delve into

  • Where Hamel is seeing the most business interest in LLMs (spoiler: the answer isn’t only tech);
  • Common misconceptions about LLMs;
  • The skills you need to work with LLMs and GenAI models;
  • Tools and techniques, such as fine-tuning, RAGs, LoRA, hardware, and more!
  • Vendor APIs vs OSS models.

LINKS