YoVDO

The Math Behind Attention Mechanisms

Offered By: Serrano.Academy via YouTube

Tags

Attention Mechanisms Courses Mathematics Courses Machine Learning Courses Transformer Models Courses Embeddings Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Dive into the mathematical foundations of attention mechanisms in this 38-minute video, part of a three-part series demystifying Transformer models. Explore key concepts such as embeddings, context, similarity, and attention through visuals and friendly examples. Learn about the Keys, Queries, and Values matrices, essential components of the attention mechanism. Gain a deeper understanding of how these elements work together to create powerful language models. Perfect for those seeking to grasp the technical underpinnings of modern natural language processing techniques.

Syllabus

Introduction
Recap: Embeddings and Context
Similarity
Attention
The Keys and Queries Matrices
The Values Matrix
Conclusion


Taught by

Serrano.Academy

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity Natural Language Processing
Columbia University via Coursera Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent