YoVDO

Generalizable Robotic Agents Through Large-Scale Simulation

Offered By: Montreal Robotics via YouTube

Tags

Robotics Courses Machine Learning Courses Computer Vision Courses Reinforcement Learning Courses Transformers Courses Imitation Learning Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the groundbreaking research on training robotic agents through large-scale simulation in this insightful talk by Luca Weihs, research scientist and lead of the AI2-THOR team at the Allen Institute for AI. Discover how imitating shortest-path planners in simulation produces Stretch RE-1 robotic agents capable of navigating, exploring, and manipulating objects in both simulated and real-world environments using only RGB sensors. Learn about the end-to-end, transformer-based SPOC architecture and the importance of powerful visual encoders paired with extensive image augmentation. Gain insights into the massive scale and diversity of training data, involving millions of frames collected from approximately 200,000 procedurally generated houses with 40,000 unique 3D assets. Explore how scale and careful caching enable online reinforcement learning with transformers in diverse environments, leading to even more proficient agents. Understand the implications of this research for the future of generalizable robotic agents and the potential applications in real-world scenarios.

Syllabus

Luca Weihs: Generalizable robotic agents through large-scale simulation


Taught by

Montreal Robotics

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity
Computer Vision: The Fundamentals
University of California, Berkeley via Coursera
Computational Photography
Georgia Institute of Technology via Coursera
Einführung in Computer Vision
Technische Universität München (Technical University of Munich) via Coursera
Introduction to Computer Vision
Georgia Institute of Technology via Udacity