Dynamic Robot Manipulation - Learned Optimization, Deformable Materials, and the Cloud

Explore dynamic robot manipulation techniques in this 53-minute lecture by Jeffrey Ichnowski from UC Berkeley. Discover how integrating grasp analysis, motion planning, and time-parameterization can speed up robotic movements and enable high-speed manipulation. Learn about the application of deep learning to accelerate computation and the use of cloud computing for on-demand access to powerful processing capabilities. Gain insights into a new cloud-robotics framework that simplifies complex robotic tasks. Delve into topics such as trajectory optimization, obstacle constraint linearization, reinforcement learning for quadratic programs, and suction transport with deformable materials. Understand the challenges and solutions for robots operating in unstructured environments, including the integration of inertial constraints and learned policies for improved performance.

Intro
Dynamic Robot Manipulation: Learned Optimization, Deformable Materials, and the Cloud Jeffrey Ichnowski, Ph.D.
Rigid World
Combine Grasp, Motion, and Dynamics
Planning for Dynamic Deformable
Use the Cloud
Trajectory and Optimization Discretization
Obstacle Constraint Linearization
Time Optimization
Science Robotics
Quadratic Programs in Robotics
OSQP Algorithm Overview
RLQP Reinforcement Learning QP Solver
Experiment Problem Classes Randomly generated QPs from OSQP benchmark suite
Benchmark Problems and Generalization
Analysis of a Learned Policy
Introducing Inertial Constraints
Suction Transport
Suction Constraint Analytic model
Suction Failures and Deformation
Suction Cup Deformation Constraint
Suction Gripper w/ Embedded Sensor
Learning a Suction Constraint
Suction Constraint Learning Pipeline
Robots of the Lost Arc Tasks
Problem Setup
Trajectory Parameterization
Sensitivity to Initial Conditions
Reset Motion
INDy: Self-Supervised Training
Cloud-based 72-core Motion Planning
Motion Planning Compute Requirements
Serverless Computing Limitations
Serverless Computing Environment