LLMOps and GenAI at Enterprise Scale - Challenges and Opportunities

Explore the challenges and opportunities of deploying Generative AI solutions at enterprise scale in this 13-minute conference talk by Andy McMahon. Gain insights into translating POC activities into production solutions, overcoming deployment hurdles, and leveraging emerging opportunities in the field. Learn about selecting foundation models, the emerging map stack, pretraining considerations, and essential aspects like monitoring, guard rails, dynamic architecture, and team structure. Benefit from the expertise of Andy McMahon, an award-winning machine learning engineer and Head of MLOps at NatWest Group, as he shares valuable perspectives on LLMOps and GenAI implementation in enterprise environments.

Introduction
Welcome
Deployment of LLMOps
LLMOps vs GenAI
Selecting a Foundation Model
Emerging Map Stack
Pretraining
Opportunities
Challenges
Monitoring
Guard Rails
Dynamic Architecture
Team Structure
Final Thoughts
Questions