In-Context Learning in Deep Learning - How It Works in Large and Small Language Models
Offered By: Yacine Mahdid via YouTube
Course Description
Overview
Explore the concept of In-Context Learning in deep learning through this 12-minute video. Delve into the definition of In-Context Learning, understand why it's considered surprising, and examine its Bayesian framework. Learn how Large Language Models (LLMs) implement learning algorithms for In-Context Learning. Gain insights from various research papers and resources on this fascinating topic. Follow the comprehensive table of contents to navigate through key sections, including an introduction, detailed explanations, and a conclusion. Engage with the content and join the discussion in the comments for a deeper exploration of In-Context Learning in artificial intelligence.
Syllabus
- Introduction:
- Definition of In-Context Learning:
- Why is In-Context Learning Surprising?:
- Bayesian Framework for In-Context Learning:
- LLMs are Implementing Learning Algorithms for In-Context Learning:
- Conclusion:
Taught by
Yacine Mahdid
Related Courses
CMU Advanced NLP: How to Use Pre-Trained ModelsGraham Neubig via YouTube Stanford Seminar 2022 - Transformer Circuits, Induction Heads, In-Context Learning
Stanford University via YouTube Pretraining Task Diversity and the Emergence of Non-Bayesian In-Context Learning for Regression
Simons Institute via YouTube In-Context Learning: A Case Study of Simple Function Classes
Simons Institute via YouTube AI Mastery: Ultimate Crash Course in Prompt Engineering for Large Language Models
Data Science Dojo via YouTube