On the Tradeoffs of State Space Models vs. Transformers
Offered By: Simons Institute via YouTube
Course Description
Overview
Explore the fundamental tradeoffs between State Space Models (SSMs) and Transformers in this 49-minute lecture by Albert Gu from Carnegie Mellon University. Gain a high-level overview of SSMs, a recently popular subquadratic alternative to Transformers in the field of computational modeling. Delve into the characteristics of these models and understand their implications for machine learning and artificial intelligence. Learn how SSMs offer potential advantages in terms of computational efficiency while considering their trade-offs compared to the widely-used Transformer architecture. Discover insights that can inform decisions about model selection and implementation in various AI applications.
Syllabus
On the Tradeoffs of State Space Models
Taught by
Simons Institute
Related Courses
Linear CircuitsGeorgia Institute of Technology via Coursera مقدمة في هندسة الطاقة والقوى
King Abdulaziz University via Rwaq (رواق) Magnetic Materials and Devices
Massachusetts Institute of Technology via edX Linear Circuits 2: AC Analysis
Georgia Institute of Technology via Coursera Transmisión de energía eléctrica
Tecnológico de Monterrey via edX