YoVDO

LLaMA2 - What Are the Changes?

Offered By: Sam Witteveen via YouTube

Tags

LLaMA (Large Language Model Meta AI) Courses Machine Learning Courses Hugging Face Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the key changes and improvements in LLaMA2, Meta's latest large language model. Dive into the three base models, examine the LLaMA paper, and compare win rates against other models. Learn about the release of 7B, 13B, and 70B models, and understand the decision to delay the 34B model. Analyze pre-training graphs for different models and discover the role of third-party labeling and annotation. Compare RLHF implementations across various models and get hands-on with the Hugging Face LLaMA 70B chatbot. Access resources including Meta's website, HuggingFace models, and GitHub repositories for further exploration.

Syllabus

Intro
Three LLaMA Base Models
LLaMA Paper
Win Rate of LLaMA vs. Other Models
Released of Models 7B, 13B, 70B and Delaying 34B Model
Graph of Pre-training Different Models
Third Party to do Labeling and Annotating
Comparing what other people have done with RLHF
Hugging Face LLaMA 70B Chatbot


Taught by

Sam Witteveen

Related Courses

LLaMA- Open and Efficient Foundation Language Models - Paper Explained
Yannic Kilcher via YouTube
Alpaca & LLaMA - Can it Compete with ChatGPT?
Venelin Valkov via YouTube
Experimenting with Alpaca & LLaMA
Aladdin Persson via YouTube
What's LLaMA? ChatLLaMA? - And Some ChatGPT/InstructGPT
Aladdin Persson via YouTube
Llama Index - Step by Step Introduction
echohive via YouTube