YoVDO

IMPALA - Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures

Offered By: Yannic Kilcher via YouTube

Tags

Deep Reinforcement Learning Courses Artificial Intelligence Courses Distributed Systems Courses Multi-Task Learning Courses

Course Description

Overview

Explore a comprehensive analysis of IMPALA (Importance Weighted Actor-Learner Architecture), a groundbreaking distributed reinforcement learning agent designed for multi-task learning. Delve into the innovative approach that combines decoupled acting and learning with the novel V-trace off-policy correction method, enabling stable learning at high throughput. Examine how IMPALA efficiently scales to thousands of machines without compromising data efficiency or resource utilization. Discover its effectiveness in tackling complex multi-task reinforcement learning challenges, demonstrated through performance evaluations on DMLab-30 and Atari-57 environments. Learn about IMPALA's ability to achieve superior performance with less data and its capacity for positive transfer between tasks, showcasing the power of its multi-task approach in advancing the field of distributed deep reinforcement learning.

Syllabus

IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures


Taught by

Yannic Kilcher

Related Courses

6.S094: Deep Learning for Self-Driving Cars
Massachusetts Institute of Technology via Independent
Natural Language Processing (NLP)
Microsoft via edX
Deep Reinforcement Learning
Nvidia Deep Learning Institute via Udacity
Advanced AI: Deep Reinforcement Learning in Python
Udemy
Self-driving go-kart with Unity-ML
Udemy