Understanding the Expressive Power of Transformers Through Formal Language Theory
Offered By: Simons Institute via YouTube
Course Description
Overview
Explore recent developments at the intersection of formal language theory and machine learning in this 37-minute lecture by Anthony Lin from TU Kaiserslautern. Delve into the expressiveness of transformers and learn about their capabilities through the lens of formal language theory. Examine results connected to Lin's recent work, including findings from ICLR'24, and gain insights into the synthesis of models and systems. Discover what can be learned with transformers and how this understanding contributes to the broader field of machine learning and language processing.
Syllabus
Understanding the expressive power of transformers through the lens of formal language theory
Taught by
Simons Institute
Related Courses
Introduction to Artificial IntelligenceStanford University via Udacity Natural Language Processing
Columbia University via Coursera Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent