YoVDO

The Emergence of Clusters in Self-Attention Dynamics

Offered By: Simons Institute via YouTube

Tags

Self-Attention Courses Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Computational Models Courses Transformers Courses Clustering Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intriguing phenomenon of cluster formation in self-attention dynamics through this 49-minute lecture by Philippe Rigollet from MIT. Delve into the computational model of Transformers and gain insights into how self-attention mechanisms lead to the emergence of distinct clusters. Examine the implications of this clustering behavior for natural language processing and other applications of Transformer architectures.

Syllabus

The emergence of clusters in self-attention dynamics


Taught by

Simons Institute

Related Courses

Natural Language Processing
Columbia University via Coursera Developmental Robotics
University of Naples Federico II via Federica Network Dynamics of Social Behavior
University of Pennsylvania via Coursera User-centric Computing For Human-Computer Interaction
Indian Institute of Technology Guwahati via Swayam People, Networks and Neighbours: Understanding Social Dynamics
University of Groningen via FutureLearn