YoVDO

Implicit Regularization I

Offered By: Simons Institute via YouTube

Tags

Implicit Regularization Courses Deep Learning Courses Gradient Descent Courses Stochastic Optimization Courses Stochastic Gradient Descent Courses Matrix Completion Courses

Course Description

Overview

Explore the concept of implicit regularization in deep learning through this comprehensive lecture from the Deep Learning Boot Camp. Delve into topics such as boosting, complexity control, optimization landscapes, and biases in matrix completion. Understand the goal of learning through practical examples and gain insights into stochastic optimization techniques. Examine the intricacies of gradient descent and stochastic gradient descent, and their roles in implicit regularization. Learn from Nati Srebro of the Toyota Technological Institute at Chicago as he provides an in-depth analysis of this crucial aspect of machine learning.

Syllabus

Introduction
Boosting
Complexity Control
Optimization Landscape
Biases
Matrix Completion
Gradient Descent
Outline
Goal of Learning
Example
Stochastic Optimization
Recap
Stochastic Gradient Descent


Taught by

Simons Institute

Related Courses

Neural Networks for Machine Learning
University of Toronto via Coursera
機器學習技法 (Machine Learning Techniques)
National Taiwan University via Coursera
Machine Learning Capstone: An Intelligent Application with Deep Learning
University of Washington via Coursera
Прикладные задачи анализа данных
Moscow Institute of Physics and Technology via Coursera
Leading Ambitious Teaching and Learning
Microsoft via edX