A Survey of Production RAG Pain Points and Solutions

Explore the challenges and solutions of implementing Retrieval Augmented Generation (RAG) in production environments during this 30-minute conference talk by Jerry Liu at the AI in Production Conference. Gain insights into the complexities of building production-ready RAG applications, including chatbots, document search tools, workflow agents, and conversational assistants using Large Language Models (LLMs) on private data. Discover the various parameters and potential failure points throughout the RAG stack that AI engineers must address to successfully deploy their applications. Learn about the current landscape of pain points and solutions in production RAG, and get a glimpse into the future evolution of this architecture. Benefit from the expertise of Jerry Liu, co-founder and CEO of LlamaIndex, who brings extensive experience in machine learning, research, and startups to this comprehensive overview of RAG in production environments.

A Survey of Production RAG Pain Points and Solutions // Jerry Liu // AI in Production Conference