YoVDO

The Emergence of Clusters in Self-Attention Dynamics

Offered By: Simons Institute via YouTube

Tags

Self-Attention Courses Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Computational Models Courses Transformers Courses Clustering Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intriguing phenomenon of cluster formation in self-attention dynamics through this 49-minute lecture by Philippe Rigollet from MIT. Delve into the computational model of Transformers and gain insights into how self-attention mechanisms lead to the emergence of distinct clusters. Examine the implications of this clustering behavior for natural language processing and other applications of Transformer architectures.

Syllabus

The emergence of clusters in self-attention dynamics


Taught by

Simons Institute

Related Courses

Neural Networks for Machine Learning
University of Toronto via Coursera Good Brain, Bad Brain: Basics
University of Birmingham via FutureLearn Statistical Learning with R
Stanford University via edX Machine Learning 1—Supervised Learning
Brown University via Udacity Fundamentals of Neuroscience, Part 2: Neurons and Networks
Harvard University via edX