YoVDO

IMPALA - Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures

Offered By: Yannic Kilcher via YouTube

Tags

Deep Reinforcement Learning Courses Artificial Intelligence Courses Distributed Systems Courses Multi-Task Learning Courses

Course Description

Overview

Explore a comprehensive analysis of IMPALA (Importance Weighted Actor-Learner Architecture), a groundbreaking distributed reinforcement learning agent designed for multi-task learning. Delve into the innovative approach that combines decoupled acting and learning with the novel V-trace off-policy correction method, enabling stable learning at high throughput. Examine how IMPALA efficiently scales to thousands of machines without compromising data efficiency or resource utilization. Discover its effectiveness in tackling complex multi-task reinforcement learning challenges, demonstrated through performance evaluations on DMLab-30 and Atari-57 environments. Learn about IMPALA's ability to achieve superior performance with less data and its capacity for positive transfer between tasks, showcasing the power of its multi-task approach in advancing the field of distributed deep reinforcement learning.

Syllabus

IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures


Taught by

Yannic Kilcher

Related Courses

Advanced Operating Systems
Georgia Institute of Technology via Udacity
High Performance Computing
Georgia Institute of Technology via Udacity
GT - Refresher - Advanced OS
Georgia Institute of Technology via Udacity
Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX
CS125x: Advanced Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX