Understanding the Expressive Power of Transformers Through Formal Language Theory
Offered By: Simons Institute via YouTube
Course Description
Overview
Explore recent developments at the intersection of formal language theory and machine learning in this 37-minute lecture by Anthony Lin from TU Kaiserslautern. Delve into the expressiveness of transformers and learn about their capabilities through the lens of formal language theory. Examine results connected to Lin's recent work, including findings from ICLR'24, and gain insights into the synthesis of models and systems. Discover what can be learned with transformers and how this understanding contributes to the broader field of machine learning and language processing.
Syllabus
Understanding the expressive power of transformers through the lens of formal language theory
Taught by
Simons Institute
Related Courses
Neural Networks for Machine LearningUniversity of Toronto via Coursera Good Brain, Bad Brain: Basics
University of Birmingham via FutureLearn Statistical Learning with R
Stanford University via edX Machine Learning 1—Supervised Learning
Brown University via Udacity Fundamentals of Neuroscience, Part 2: Neurons and Networks
Harvard University via edX