IMPALA - Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
Offered By: Yannic Kilcher via YouTube
Course Description
Overview
Explore a comprehensive analysis of IMPALA (Importance Weighted Actor-Learner Architecture), a groundbreaking distributed reinforcement learning agent designed for multi-task learning. Delve into the innovative approach that combines decoupled acting and learning with the novel V-trace off-policy correction method, enabling stable learning at high throughput. Examine how IMPALA efficiently scales to thousands of machines without compromising data efficiency or resource utilization. Discover its effectiveness in tackling complex multi-task reinforcement learning challenges, demonstrated through performance evaluations on DMLab-30 and Atari-57 environments. Learn about IMPALA's ability to achieve superior performance with less data and its capacity for positive transfer between tasks, showcasing the power of its multi-task approach in advancing the field of distributed deep reinforcement learning.
Syllabus
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
Taught by
Yannic Kilcher
Related Courses
6.S094: Deep Learning for Self-Driving CarsMassachusetts Institute of Technology via Independent Natural Language Processing (NLP)
Microsoft via edX Deep Reinforcement Learning
Nvidia Deep Learning Institute via Udacity Advanced AI: Deep Reinforcement Learning in Python
Udemy Self-driving go-kart with Unity-ML
Udemy