YoVDO

The Effectiveness of Nonconvex Tensor Completion - Fast Convergence and Uncertainty Quantification

Offered By: Institute for Pure & Applied Mathematics (IPAM) via YouTube

Tags

Statistical Modeling Courses Data Science Courses Machine Learning Courses Uncertainty Quantification Courses Nonconvex Optimization Courses

Course Description

Overview

Explore the effectiveness of nonconvex optimization for noisy tensor completion in this 33-minute conference talk from the Tensor Methods and Emerging Applications to the Physical and Data Sciences 2021 workshop. Delve into Yuxin Chen's presentation on a two-stage nonconvex algorithm that addresses the high-volatility issue in sample-starved regimes, enabling linear convergence, minimal sample complexity, and minimax statistical accuracy. Learn about the characterization of the nonconvex estimator's distribution and its application in constructing entrywise confidence intervals for unseen tensor entries and unknown tensor factors. Gain insights into the role of statistical models in facilitating efficient and guaranteed nonconvex statistical learning, covering topics such as imperfect data acquisition, statistical computational gaps, gradient descent challenges, and key proof ideas like leave-one-out decoupling.

Syllabus

Intro
Imperfect data acquisition
Statistical computational gap
Prior art
A nonconvex least squares formulation
Gradient descent (GD) with random initialization?
A negative conjecture
Our proposal: a two-stage nonconvex algorithm
Rationale of two-stage approach
A bit more details about initialization
Assumptions
Numerical experiments
No need of sample splitting
Key proof ideas leave one-out decoupling
Distributional theory
Back to estimation


Taught by

Institute for Pure & Applied Mathematics (IPAM)

Related Courses

On Gradient-Based Optimization - Accelerated, Distributed, Asynchronous and Stochastic
Simons Institute via YouTube
Optimisation - An Introduction: Professor Coralia Cartis, University of Oxford
Alan Turing Institute via YouTube
Optimization in Signal Processing and Machine Learning
IEEE Signal Processing Society via YouTube
Methods for L_p-L_q Minimization in Image Restoration and Regression - SIAM-IS Seminar
Society for Industrial and Applied Mathematics via YouTube
Certificates of Nonnegativity and Their Applications in Theoretical Computer Science
Society for Industrial and Applied Mathematics via YouTube