YoVDO

The Emergence of Clusters in Self-Attention Dynamics

Offered By: Simons Institute via YouTube

Tags

Self-Attention Courses Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Computational Models Courses Transformers Courses Clustering Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intriguing phenomenon of cluster formation in self-attention dynamics through this 49-minute lecture by Philippe Rigollet from MIT. Delve into the computational model of Transformers and gain insights into how self-attention mechanisms lead to the emergence of distinct clusters. Examine the implications of this clustering behavior for natural language processing and other applications of Transformer architectures.

Syllabus

The emergence of clusters in self-attention dynamics


Taught by

Simons Institute

Related Courses

Neural Networks for Machine Learning
University of Toronto via Coursera 機器學習技法 (Machine Learning Techniques)
National Taiwan University via Coursera Machine Learning Capstone: An Intelligent Application with Deep Learning
University of Washington via Coursera Прикладные задачи анализа данных
Moscow Institute of Physics and Technology via Coursera Leading Ambitious Teaching and Learning
Microsoft via edX