LLMs vs LMs in Production - Key Differences in Using 100M vs 100B Parameter Models

Explore the key differences between using 100M and 100B parameter models in production in this 25-minute conference talk by Denys Linkov from Voiceflow. Gain insights into how MLOps processes vary between smaller transformer models and Large Language Models (LLMs). Discover the intricacies of Voiceflow's four main production models, including their processes and product planning. Learn about prompt testing, automated training, and real-time inference in the context of NLP systems for conversational assistants. Benefit from Denys' expertise as ML lead at Voiceflow, where he focuses on building ML platforms and data science offerings for enterprise customers. Understand the challenges and opportunities in implementing LLMs and smaller language models in production environments.

LLMs vs LMs in Prod // Denys Linkov // LLMs in Production Conference Part 2