Training LLMs: Lessons from the Trenches
Offered By: MLOps World: Machine Learning in Production via YouTube
Course Description
Overview
Explore the challenges and lessons learned from training large AI language models in this 30-minute conference talk from MLOps World: Machine Learning in Production. Gain insights from Bandish Shah, Engineering Manager at MosaicML/Databricks, as he shares experiences in handling massive datasets, designing effective model architectures, optimizing training procedures, and managing computational resources across hundreds of GPUs. Discover the intricacies of training models with billions of parameters and delve into the "sausage making" behind large language models. Suitable for ML researchers, practitioners, and those curious about the complexities of training advanced AI systems.
Syllabus
Training LLMs: Lessons from the Trenches
Taught by
MLOps World: Machine Learning in Production
Related Courses
Моделирование биологических молекул на GPU (Biomolecular modeling on GPU)Moscow Institute of Physics and Technology via Coursera Practical Deep Learning For Coders
fast.ai via Independent GPU Architectures And Programming
Indian Institute of Technology, Kharagpur via Swayam Perform Real-Time Object Detection with YOLOv3
Coursera Project Network via Coursera Getting Started with PyTorch
Coursera Project Network via Coursera