YoVDO

LLaMA2 - What Are the Changes?

Offered By: Sam Witteveen via YouTube

Tags

LLaMA (Large Language Model Meta AI) Courses Machine Learning Courses Hugging Face Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the key changes and improvements in LLaMA2, Meta's latest large language model. Dive into the three base models, examine the LLaMA paper, and compare win rates against other models. Learn about the release of 7B, 13B, and 70B models, and understand the decision to delay the 34B model. Analyze pre-training graphs for different models and discover the role of third-party labeling and annotation. Compare RLHF implementations across various models and get hands-on with the Hugging Face LLaMA 70B chatbot. Access resources including Meta's website, HuggingFace models, and GitHub repositories for further exploration.

Syllabus

Intro
Three LLaMA Base Models
LLaMA Paper
Win Rate of LLaMA vs. Other Models
Released of Models 7B, 13B, 70B and Delaying 34B Model
Graph of Pre-training Different Models
Third Party to do Labeling and Annotating
Comparing what other people have done with RLHF
Hugging Face LLaMA 70B Chatbot


Taught by

Sam Witteveen

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity
Natural Language Processing
Columbia University via Coursera
Probabilistic Graphical Models 1: Representation
Stanford University via Coursera
Computer Vision: The Fundamentals
University of California, Berkeley via Coursera
Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent