State Space Models: Advancements and Applications in AI - Featuring Albert Gu and Karan Goel
Offered By: Aleksa Gordić - The AI Epiphany via YouTube
Course Description
Overview
Dive into a comprehensive video lecture on state space models featuring Albert Gu and Karan Goel from Cartesia AI. Explore the cutting-edge research in SSMs competing against transformer supremacy, including insights from the seminal S4 paper and the Mamba paper. Learn about real-time intelligence, text-to-speech demos, and the fundamental concepts of state space models. Examine the trade-offs between SSMs and transformers, understand how SSMs are computed convolutionally, and compare different state representations in machine learning models. Discover the latest developments in Mamba 2 and discuss scaling laws in AI. Gain valuable knowledge from these pioneering researchers in the field of state space models and their applications in artificial intelligence.
Syllabus
00:00:00 - Intro
00:01:56 - Hyperstack GPUs! sponsored
00:03:37 - Cartesia AI, real-time intelligence
00:09:45 - text-to-speech demo
00:12:05 - state space models SSMs
00:36:35 - bitter lessons transformers vs SSMs
00:38:30 - free lunch? what are the actual tradeoffs?
00:41:30 - Computing SSMs convolutionally
00:42:55 - What is the state RNNs, Attention, Conv, Neural ODEs
00:50:00 - Mamba 2, discrete vs continuous spectrum
00:55:30 - Q&A: scaling laws
Taught by
Aleksa Gordić - The AI Epiphany
Related Courses
Linear CircuitsGeorgia Institute of Technology via Coursera مقدمة في هندسة الطاقة والقوى
King Abdulaziz University via Rwaq (رواق) Magnetic Materials and Devices
Massachusetts Institute of Technology via edX Linear Circuits 2: AC Analysis
Georgia Institute of Technology via Coursera Transmisión de energía eléctrica
Tecnológico de Monterrey via edX