LLMOps and FMOps for E-commerce - Booking.com Case Study

Explore the evolving MLOps ecosystem in high-tech organizations, focusing on the e-commerce sector, in this 21-minute conference talk by Sanchit Juneja, Director-Product of Big Data & Machine Learning Platform at Booking.com. Delve into the impact of large language models (LLMs) on operational paradigms and key investment areas for supporting current and future use cases. Gain insights into typical MLOps ecosystems, the introduction of foundational model operations (FMOps), and critical infrastructure enhancements for advanced AI applications. Learn from real-world examples at Booking.com, including LLM-based service implementation and scaling challenges. Discover how cutting-edge MLOps practices are leveraged to maintain a competitive edge in e-commerce, and understand the strategic investments required to maximize the potential of machine learning and AI. Topics covered include terminology, data layer, model building and serving, feature stores, prompt stores, LLM governance and observability, experimentation, and model evaluation optimization.

Introduction
Terminology
Data Layer
Model Building
Model Serving
Feature Stores
Prompt Stores
LLM Governance
LLM Observability
Experimentation
Model Evaluation Optimization
Summary