YoVDO

Nonconvex Optimization in Matrix Optimization and Distributionally Robust Optimization

Offered By: Institute for Pure & Applied Mathematics (IPAM) via YouTube

Tags

Matrix Completion Courses Machine Learning Courses Computational Analysis Courses Nonconvex Optimization Courses Distributionally Robust Optimization Courses

Course Description

Overview

Explore nonconvex optimization techniques in matrix optimization and distributionally robust optimization through this 55-minute lecture by Stephen Wright from the University of Wisconsin. Delivered at the Intersections between Control, Learning and Optimization 2020 conference, hosted by the Institute for Pure and Applied Mathematics at UCLA. Delve into topics such as unconstrained nonconvex complexity, algorithms for smooth nonconvex optimization, operation complexity, line search Newton CG procedures, and nonconvex optimization in machine learning. Examine computational results, the matrix completion problem, and learn about smoothing the ramp loss function. Gain insights into the motivations, context, and practical applications of these advanced optimization techniques in various fields.

Syllabus

Intro
Outline
Nonconvex Complexity Motivation and Context
Unconstrained Nonconvex Complexity
Algorithms for Smooth Nonconvex Optimization
Operation Complexity
Line Search Newton CG Procedures Royer, O'Neill
Complexity Results
Computational Results
Nonconvex Optimization in ML
Example Matrix Completion (Symmetric)
Sketch of the Algorithm
Smoothing the Ramp Loss Function
Summary


Taught by

Institute for Pure & Applied Mathematics (IPAM)

Related Courses

On Gradient-Based Optimization - Accelerated, Distributed, Asynchronous and Stochastic
Simons Institute via YouTube
Optimisation - An Introduction: Professor Coralia Cartis, University of Oxford
Alan Turing Institute via YouTube
Optimization in Signal Processing and Machine Learning
IEEE Signal Processing Society via YouTube
Methods for L_p-L_q Minimization in Image Restoration and Regression - SIAM-IS Seminar
Society for Industrial and Applied Mathematics via YouTube
Certificates of Nonnegativity and Their Applications in Theoretical Computer Science
Society for Industrial and Applied Mathematics via YouTube