YoVDO

Distributed Training - Part I - Lecture 17

Offered By: MIT HAN Lab via YouTube

Tags

Distributed Training Courses Machine Learning Courses Parallel Computing Courses GPU Computing Courses Scalability Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore distributed training techniques in machine learning with this comprehensive lecture from MIT's 6.5940 course. Delve into the first part of distributed training, led by Professor Song Han, as part of the EfficientML.ai series. Learn about the fundamental concepts, challenges, and strategies for scaling machine learning models across multiple devices or nodes. Gain insights into parallel processing, data parallelism, and model parallelism techniques that enable training of large-scale models efficiently. Understand the importance of distributed training in modern AI applications and its impact on accelerating the development of complex neural networks. Access accompanying slides at efficientml.ai to enhance your learning experience and follow along with the lecture content.

Syllabus

EfficientML.ai Lecture 17: Distributed Training (Part I) (MIT 6.5940, Fall 2023, Zoom)


Taught by

MIT HAN Lab

Related Courses

Financial Sustainability: The Numbers side of Social Enterprise
+Acumen via NovoEd
Cloud Computing Concepts: Part 2
University of Illinois at Urbana-Champaign via Coursera
Developing Repeatable ModelsĀ® to Scale Your Impact
+Acumen via Independent
Managing Microsoft Windows Server Active Directory Domain Services
Microsoft via edX
Introduction aux conteneurs
Microsoft Virtual Academy via OpenClassrooms