Approximation of optimization problems with constraints through kernel Sum-Of-Squares

Handling an infinite number of inequality constraints in infinite-dimensional spaces occurs in many fields, from global optimization to optimal transport. These problems have been tackled individually in several previous articles through kernel Sum-Of-Squares (kSoS) approximations. We propose here a unified theorem to prove convergence guarantees for these schemes. Inequalities are turned into equalities to a class of nonnegative kSoS functions. This enables the use of scattering inequalities to mitigate the curse of dimensionality in sampling the constraints, leveraging the assumed smoothness of the functions appearing in the problem. This approach is illustrated in learning vector fields with side information, here the invariance of a set.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/28/2023

Theory and applications of the Sum-Of-Squares technique

The Sum-of-Squares (SOS) approximation method is a technique used in opt...
research
12/22/2020

Finding Global Minima via Kernel Approximations

We consider the global minimization of smooth functions based solely on ...
research
04/11/2022

Non-Convex Optimization with Certificates and Fast Rates Through Kernel Sums of Squares

We consider potentially non-convex optimization problems, for which opti...
research
10/09/2017

Response to "Counterexample to global convergence of DSOS and SDSOS hierarchies"

In a recent note [8], the author provides a counterexample to the global...
research
02/02/2013

Sharp Inequalities for f-divergences

f-divergences are a general class of divergences between probability mea...
research
01/05/2021

Handling Hard Affine SDP Shape Constraints in RKHSs

Shape constraints, such as non-negativity, monotonicity, convexity or su...
research
07/15/2021

The Information Projection in Moment Inequality Models: Existence, Dual Representation, and Approximation

This paper presents new existence, dual representation and approximation...

Please sign up or login with your details

Forgot password? Click here to reset