Current State of LLMs in Production - Lightning Talk

Explore the current landscape of Large Language Models (LLMs) in production environments in this 12-minute lightning talk by Apurva Misra, Senior Machine Learning Engineer at Truckstop.com. Gain insights into LLM capabilities, deployment strategies, and challenges faced when implementing these models in real-world systems. Learn about RAG models, chunking techniques, embeddings, vector databases, and methods for retrieving relevant chunks of information. Discover evaluation approaches and benefit from Apurva's personal experiences in the field. Perfect for those interested in the practical applications of Natural Language Processing advancements and the integration of LLMs into production systems.

Intro
LLM Models in Production
Rag Model
Chunking
Embedding
Vector Databases
Relevant Chunks
Evaluation
My Experience