YoVDO

The Math Behind Attention Mechanisms

Offered By: Serrano.Academy via YouTube

Tags

Attention Mechanisms Courses Mathematics Courses Machine Learning Courses Transformer Models Courses Embeddings Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Dive into the mathematical foundations of attention mechanisms in this 38-minute video, part of a three-part series demystifying Transformer models. Explore key concepts such as embeddings, context, similarity, and attention through visuals and friendly examples. Learn about the Keys, Queries, and Values matrices, essential components of the attention mechanism. Gain a deeper understanding of how these elements work together to create powerful language models. Perfect for those seeking to grasp the technical underpinnings of modern natural language processing techniques.

Syllabus

Introduction
Recap: Embeddings and Context
Similarity
Attention
The Keys and Queries Matrices
The Values Matrix
Conclusion


Taught by

Serrano.Academy

Related Courses

Deep Learning for Natural Language Processing
University of Oxford via Independent Sequence Models
DeepLearning.AI via Coursera Deep Learning Part 1 (IITM)
Indian Institute of Technology Madras via Swayam Deep Learning - Part 1
Indian Institute of Technology, Ropar via Swayam Deep Learning - IIT Ropar
Indian Institute of Technology, Ropar via Swayam