Non-Convex Optimization with Certificates and Fast Rates Through Kernel Sums of Squares

04/11/2022
by   Blake Woodworth, et al.
0

We consider potentially non-convex optimization problems, for which optimal rates of approximation depend on the dimension of the parameter space and the smoothness of the function to be optimized. In this paper, we propose an algorithm that achieves close to optimal a priori computational guarantees, while also providing a posteriori certificates of optimality. Our general formulation builds on infinite-dimensional sums-of-squares and Fourier analysis, and is instantiated on the minimization of multivariate periodic functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2020

Recent Theoretical Advances in Non-Convex Optimization

Motivated by recent increased interest in optimization algorithms for no...
research
06/02/2023

Convex and Non-Convex Optimization under Generalized Smoothness

Classical analysis of convex and non-convex optimization methods often r...
research
02/29/2020

Dimension-free convergence rates for gradient Langevin dynamics in RKHS

Gradient Langevin dynamics (GLD) and stochastic GLD (SGLD) have attracte...
research
01/16/2023

Approximation of optimization problems with constraints through kernel Sum-Of-Squares

Handling an infinite number of inequality constraints in infinite-dimens...
research
05/29/2018

Weak Supermodularity Assists Submodularity-based Approaches to Non-convex Constrained Optimization

Non-convex constrained optimization problems have many applications in m...
research
06/28/2023

Theory and applications of the Sum-Of-Squares technique

The Sum-of-Squares (SOS) approximation method is a technique used in opt...
research
05/31/2022

Scalable Distributional Robustness in a Class of Non Convex Optimization with Guarantees

Distributionally robust optimization (DRO) has shown lot of promise in p...

Please sign up or login with your details

Forgot password? Click here to reset