IMPALA - Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
Offered By: Yannic Kilcher via YouTube
Course Description
Overview
Explore a comprehensive analysis of IMPALA (Importance Weighted Actor-Learner Architecture), a groundbreaking distributed reinforcement learning agent designed for multi-task learning. Delve into the innovative approach that combines decoupled acting and learning with the novel V-trace off-policy correction method, enabling stable learning at high throughput. Examine how IMPALA efficiently scales to thousands of machines without compromising data efficiency or resource utilization. Discover its effectiveness in tackling complex multi-task reinforcement learning challenges, demonstrated through performance evaluations on DMLab-30 and Atari-57 environments. Learn about IMPALA's ability to achieve superior performance with less data and its capacity for positive transfer between tasks, showcasing the power of its multi-task approach in advancing the field of distributed deep reinforcement learning.
Syllabus
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
Taught by
Yannic Kilcher
Related Courses
Advanced Operating SystemsGeorgia Institute of Technology via Udacity High Performance Computing
Georgia Institute of Technology via Udacity GT - Refresher - Advanced OS
Georgia Institute of Technology via Udacity Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX CS125x: Advanced Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX