YoVDO

Towards Understanding the Implicit Regularization Effect of SGD

Offered By: MITCBMM via YouTube

Tags

Machine Learning Courses Neural Networks Courses Overfitting Courses Generalization Courses Stochastic Gradient Descent Courses Statistical Learning Theory Courses Implicit Regularization Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the implicit regularization effect of Stochastic Gradient Descent (SGD) in this comprehensive lecture by Pierfrancesco Beneventano from Princeton University. Delve into the intricacies of SGD's impact on machine learning models, examining how this optimization algorithm influences model performance and generalization. Gain insights into the theoretical foundations and practical implications of SGD's implicit regularization, enhancing your understanding of this crucial aspect of deep learning optimization.

Syllabus

Towards Understanding the Implicit Regularization Effect of SGD


Taught by

MITCBMM

Related Courses

Training More Effective Learned Optimizers, and Using Them to Train Themselves - Paper Explained
Yannic Kilcher via YouTube Understanding Deep Learning Requires Rethinking Generalization
University of Central Florida via YouTube Implicit Regularization I
Simons Institute via YouTube Benign Overfitting - Peter Bartlett, UC Berkeley
Alan Turing Institute via YouTube Big Data Is Low Rank - Madeleine Udell, Cornell University
Alan Turing Institute via YouTube