YoVDO

The Emergence of Clusters in Self-Attention Dynamics

Offered By: Simons Institute via YouTube

Tags

Self-Attention Courses Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Computational Models Courses Transformers Courses Clustering Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intriguing phenomenon of cluster formation in self-attention dynamics through this 49-minute lecture by Philippe Rigollet from MIT. Delve into the computational model of Transformers and gain insights into how self-attention mechanisms lead to the emergence of distinct clusters. Examine the implications of this clustering behavior for natural language processing and other applications of Transformer architectures.

Syllabus

The emergence of clusters in self-attention dynamics


Taught by

Simons Institute

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Artificial Intelligence for Robotics
Stanford University via Udacity Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent