Transformer Expressivity and Formal Logic
Offered By: Simons Institute via YouTube
Course Description
Overview
Explore a thought-provoking lecture on the relationship between transformers and formal logic systems. Delve into David Chiang's research findings, both published and unpublished, that connect transformers to first-order logic, linear temporal logic, and their counting extensions. Gain insights into the capabilities and limitations of transformers as a computational model, and understand how factors like depth impact their expressivity. This 46-minute talk, presented at the Simons Institute, offers a deep dive into the theoretical underpinnings of transformer models and their connections to established logical frameworks.
Syllabus
Transformer Expressivity and Formal Logic
Taught by
Simons Institute
Related Courses
Model CheckingChennai Mathematical Institute via Swayam Model Checking and Temporal Logic - E. Allen Emerson's Turing Award Lecture
Association for Computing Machinery (ACM) via YouTube Requirement Specifications for Autonomous Systems
University of Colorado Boulder via Coursera Verification and Synthesis of Autonomous Systems
University of Colorado Boulder via Coursera Symbolic Finite- and Infinite-state Synthesis
Simons Institute via YouTube