Introduction to Transformers
Offered By: Simons Institute via YouTube
Course Description
Overview
Dive into a comprehensive lecture on the fundamentals of Transformer models, delivered by Daniel Hsu from Columbia University as part of the Special Year on Large Language Models and Transformers: Part 1 Boot Camp at the Simons Institute. Explore the architecture, mechanisms, and applications of these groundbreaking neural network models that have revolutionized natural language processing and beyond. Gain insights into the key components of Transformers, including self-attention and positional encoding, and understand their impact on various AI tasks. This 70-minute talk provides a solid foundation for both beginners and intermediate learners looking to grasp the core concepts behind one of the most influential innovations in modern machine learning.
Syllabus
Introduction to Transformers
Taught by
Simons Institute
Related Courses
Neural Networks for Machine LearningUniversity of Toronto via Coursera Good Brain, Bad Brain: Basics
University of Birmingham via FutureLearn Statistical Learning with R
Stanford University via edX Machine Learning 1—Supervised Learning
Brown University via Udacity Fundamentals of Neuroscience, Part 2: Neurons and Networks
Harvard University via edX