YoVDO

TinyRL: Teaching AI to Swing Up a Real Pendulum

Offered By: Digi-Key via YouTube

Tags

Reinforcement Learning Courses Machine Learning Courses Robotics Courses Python Courses Arduino Courses Embedded Systems Courses ESP32 Courses Hyperparameter Optimization Courses Deep Neural Networks Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the application of reinforcement learning to teach an AI to swing up a real pendulum in this 22-minute video. Learn about hardware setup, Arduino communication, reinforcement learning concepts, reward functions, and deep neural networks. Follow the process of agent training, troubleshooting, and deployment to an ESP32. Discover how to modify the project scope, optimize hyperparameters, and implement a discrete action space for successful learning. Gain insights into practical challenges and solutions when applying AI to physical systems, and consider potential areas for further research in this fascinating intersection of machine learning and robotics.

Syllabus

- Introduction
- Hardware overview
- Modifying the pendulum tower
- Arduino communication interface
- Overview of reinforcement learning
- Reward function
- Agent actor-critic deep neural network
- Hyperparameter optimization overview
- Agent training with Python
- Troubleshooting an agent that does not learn
- Reduce scope to just swing up and use discrete action space
- Train simpler agent
- Deploy agent to ESP32
- Test agent on the pendulum
- Conclusion and further areas of research


Taught by

Digi-Key

Related Courses

Wie programmiere ich meinen ersten Mini-Computer?
openHPI
ESP32 - Treinamento Essencial
Udemy
ESP32 Bootcamp: A Step By Step Practical Approach
Udemy
Harness the Power of ESP32—No Code Required!
Udemy
IoT Microcontrollers: Onboarding an ESP32 with Amazon FreeRTOS
Amazon Web Services via AWS Skill Builder