YoVDO

SGD and Weight Decay Secretly Compress Your Neural Network

Offered By: MITCBMM via YouTube

Tags

Machine Learning Courses Deep Learning Courses Optimization Algorithms Courses Stochastic Gradient Descent Courses Model Compression Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intriguing concept of how Stochastic Gradient Descent (SGD) and weight decay techniques inadvertently compress neural networks in this insightful 55-minute conference talk by Tomer Galanti from MIT. Delve into the underlying mechanisms that contribute to this hidden compression effect, gaining a deeper understanding of how these widely-used optimization methods impact the efficiency and performance of deep learning models.

Syllabus

SGD and Weight Decay Secretly Compress Your Neural Network


Taught by

MITCBMM

Related Courses

Deep Learning for Natural Language Processing
University of Oxford via Independent Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization
DeepLearning.AI via Coursera Deep Learning Part 1 (IITM)
Indian Institute of Technology Madras via Swayam Deep Learning - Part 1
Indian Institute of Technology, Ropar via Swayam Logistic Regression with Python and Numpy
Coursera Project Network via Coursera