Stanford Seminar - Decision Transformer: Reinforcement Learning via Sequence Modeling

Explore a groundbreaking approach to reinforcement learning in this Stanford seminar featuring Aditya Grover. Discover how the Decision Transformer framework abstracts reinforcement learning as a sequence modeling problem, leveraging the Transformer architecture's simplicity and scalability. Learn about the innovative method that casts reinforcement learning as conditional sequence modeling, outputting optimal actions through a causally masked Transformer. Understand how this approach, by conditioning an autoregressive model on desired return, past states, and actions, generates future actions to achieve the desired outcome. Examine the impressive performance of Decision Transformer, which matches or exceeds state-of-the-art model-free offline reinforcement learning baselines on various tasks. Gain insights from Aditya Grover, a distinguished researcher in probabilistic machine learning, as he discusses the foundations and applications of this novel technique at the intersection of physical sciences and climate change.

CS25 I Stanford Seminar 2022 - Decision Transformer: Reinforcement Learning via Sequence Modeling