YoVDO

Developing and Serving RAG-Based LLM Applications in Production

Offered By: Anyscale via YouTube

Tags

Retrieval Augmented Generation Courses Scalability Courses Embeddings Courses Mixture-of-Experts Courses Anyscale Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a comprehensive guide for developing retrieval augmented generation (RAG) based LLM applications in production. Learn about scaling techniques for embedding, indexing, and serving, as well as component-wise and overall evaluation methods. Discover advanced topics like hybrid routing to bridge the gap between open-source and closed LLMs. Gain insights on evaluating RAG-based LLM applications to identify and productionize optimal configurations. Understand how to develop LLM applications with scalable workloads using minimal code changes. Explore the potential of Mixture of Experts (MoE) routing in enhancing LLM performance. Access the accompanying slide deck for visual references and additional information on developing and serving RAG-based LLM applications at scale.

Syllabus

Developing and Serving RAG-Based LLM Applications in Production


Taught by

Anyscale

Related Courses

GShard- Scaling Giant Models with Conditional Computation and Automatic Sharding
Yannic Kilcher via YouTube
Learning Mixtures of Linear Regressions in Subexponential Time via Fourier Moments
Association for Computing Machinery (ACM) via YouTube
Modules and Architectures
Alfredo Canziani via YouTube
Stanford Seminar - Mixture of Experts Paradigm and the Switch Transformer
Stanford University via YouTube
Decoding Mistral AI's Large Language Models - Building Blocks and Training Strategies
Databricks via YouTube