Benefits of Randomization on First Order Algorithms for Min-Max Optimization
January 30, 2023
Time: 3:00-4:00pm
Location: Math Annex 1100
Live presentation only
Pre colloquium reception Tea/coffee and light snacks IAM lounge LSK 306
Modern data science applications require solving high dimensional optimization problems with large number of data points. Min-max optimization provides a unified framework for many problems in this context ranging from empirical risk minimization and distributionally robust optimization in machine learning to medical imaging and nonlinear programming. This talk will present two approaches for using randomization to design simple, practical and adaptive optimization algorithms that improve the complexity guarantees for convex-concave optimization. I will describe first order primal-dual algorithms with random coordinate updates and discuss their complexity guarantees as well as practical adaptivity properties. I will then present an algorithm with stochastic variance reduction that harnesses the finite-sum min-max structure to obtain sharp complexity bounds.
Event Details
January 30, 2023
3:00pm
, , CA