YoVDO

The Emergence of Clusters in Self-Attention Dynamics

Offered By: Simons Institute via YouTube

Tags

Self-Attention Courses Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Computational Models Courses Transformers Courses Clustering Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intriguing phenomenon of cluster formation in self-attention dynamics through this 49-minute lecture by Philippe Rigollet from MIT. Delve into the computational model of Transformers and gain insights into how self-attention mechanisms lead to the emergence of distinct clusters. Examine the implications of this clustering behavior for natural language processing and other applications of Transformer architectures.

Syllabus

The emergence of clusters in self-attention dynamics


Taught by

Simons Institute

Related Courses

Linear Circuits
Georgia Institute of Technology via Coursera مقدمة في هندسة الطاقة والقوى
King Abdulaziz University via Rwaq (رواق) Magnetic Materials and Devices
Massachusetts Institute of Technology via edX Linear Circuits 2: AC Analysis
Georgia Institute of Technology via Coursera Transmisión de energía eléctrica
Tecnológico de Monterrey via edX