The Confidence Checklist for LLMs in Production

Explore a comprehensive conference talk on securing and gaining confidence in large language model (LLM) deployments in production environments. Delve into practical and implementable strategies to address the challenges of probabilistic systems, including performance assessment, user satisfaction evaluation, and identifying areas for improvement. Learn from Rohit Agarwal's two years of experience with large-scale LLM deployments as he shares insights on building robust infrastructure stacks for both foundation model APIs and open-source models. Gain valuable knowledge on monitoring, model management, and compliance in LLM systems to enhance your production deployment confidence.

The Confidence Checklist for LLMs in Production // Rohit Agarwal // LLMs in Prod Conference Part 2