YoVDO

State Space Models: Advancements and Applications in AI - Featuring Albert Gu and Karan Goel

Offered By: Aleksa Gordić - The AI Epiphany via YouTube

Tags

Machine Learning Courses Artificial Intelligence Courses Neural Networks Courses Transformers Courses Text to Speech Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Dive into a comprehensive video lecture on state space models featuring Albert Gu and Karan Goel from Cartesia AI. Explore the cutting-edge research in SSMs competing against transformer supremacy, including insights from the seminal S4 paper and the Mamba paper. Learn about real-time intelligence, text-to-speech demos, and the fundamental concepts of state space models. Examine the trade-offs between SSMs and transformers, understand how SSMs are computed convolutionally, and compare different state representations in machine learning models. Discover the latest developments in Mamba 2 and discuss scaling laws in AI. Gain valuable knowledge from these pioneering researchers in the field of state space models and their applications in artificial intelligence.

Syllabus

00:00:00 - Intro
00:01:56 - Hyperstack GPUs! sponsored
00:03:37 - Cartesia AI, real-time intelligence
00:09:45 - text-to-speech demo
00:12:05 - state space models SSMs
00:36:35 - bitter lessons transformers vs SSMs
00:38:30 - free lunch? what are the actual tradeoffs?
00:41:30 - Computing SSMs convolutionally
00:42:55 - What is the state RNNs, Attention, Conv, Neural ODEs
00:50:00 - Mamba 2, discrete vs continuous spectrum
00:55:30 - Q&A: scaling laws


Taught by

Aleksa Gordić - The AI Epiphany

Related Courses

Linear Circuits
Georgia Institute of Technology via Coursera
مقدمة في هندسة الطاقة والقوى
King Abdulaziz University via Rwaq (رواق)
Magnetic Materials and Devices
Massachusetts Institute of Technology via edX
Linear Circuits 2: AC Analysis
Georgia Institute of Technology via Coursera
Transmisión de energía eléctrica
Tecnológico de Monterrey via edX