Tightening Information-Theoretic Generalization Bounds with Data-Dependent Estimates with an Application to SGLD - Daniel Roy

Explore a workshop presentation on tightening information-theoretic generalization bounds with data-dependent estimates, focusing on their application to Stochastic Gradient Langevin Dynamics (SGLD). Delve into the nature of generalization understanding, open problems, and barriers in the field. Examine non-vacuous bounds, stochastic gradient dynamics, and expected generalization error. Learn from Daniel Roy of the University of Toronto as he discusses these advanced concepts in deep learning theory, providing insights into current challenges and potential future directions in the field.

Intro
The nature of generalization understanding
Open problem
Barriers
Non vacuous bounds
Stochastic gradient dynamics
Expected generalization error
Plot
Conclusion