Training Large Language Models: Practices and Research Questions
Offered By: Simons Institute via YouTube
Course Description
Overview
Explore a comprehensive tutorial on training large language models, covering both pre-training and post-training phases. Delve into best practices at each stage of training, drawing from open models and public research papers. Learn about data curation, training algorithms, and safety mitigations. Gain insights into the pipeline for developing advanced language models and discover open research questions for the next generation of LLMs. Use this tutorial as a starting point to engage in discussions about the future of large language model training.
Syllabus
Training Large Language Models: Practices and Research Questions
Taught by
Simons Institute
Related Courses
Introduction to Artificial IntelligenceStanford University via Udacity Natural Language Processing
Columbia University via Coursera Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent