Scenario approach for minmax optimization with emphasis on the nonconvex case: positive results and caveats

06/04/2019
by   Mishal Assif P K, et al.
0

We treat the so-called scenario approach, a popular probabilistic approximation method for robust minmax optimization problems via independent and indentically distributed (i.i.d) sampling from the uncertainty set, from various perspectives. The scenario approach is well-studied in the important case of convex robust optimization problems, and here we examine how the phenomenon of concentration of measures affects the i.i.d sampling aspect of the scenario approach in high dimensions and its relation with the optimal values. Moreover, we perform a detailed study of both the asymptotic behaviour (consistency) and finite time behaviour of the scenario approach in the more general setting of nonconvex minmax optimization problems. In the direction of the asymptotic behaviour of the scenario approach, we present an obstruction to consistency that arises when the decision set is noncompact. In the direction of finite sample guarantees, we establish a general methodology for extracting `probably approximately correct' type estimates for the finite sample behaviour of the scenario approach for a large class of nonconvex problems.

READ FULL TEXT

page 8

page 10

research
02/09/2020

Better Theory for SGD in the Nonconvex World

Large-scale nonconvex optimization problems are ubiquitous in modern mac...
research
07/29/2022

Asymptotic Consistency for Nonconvex Risk-Averse Stochastic Optimization with Infinite Dimensional Decision Spaces

Optimal values and solutions of empirical approximations of stochastic o...
research
04/07/2021

Two-Stage Robust Optimization Problems with Two-Stage Uncertainty

We consider two-stage robust optimization problems, which can be seen as...
research
06/15/2022

Finite-Sample Guarantees for High-Dimensional DML

Debiased machine learning (DML) offers an attractive way to estimate tre...
research
11/05/2019

Consistency of a range of penalised cost approaches for detecting multiple changepoints

A common approach to detect multiple changepoints is to minimise a measu...
research
04/26/2019

From Predictions to Prescriptions in Multistage Optimization Problems

In this paper, we introduce a framework for solving finite-horizon multi...
research
04/26/2023

Data-driven Piecewise Affine Decision Rules for Stochastic Programming with Covariate Information

Focusing on stochastic programming (SP) with covariate information, this...

Please sign up or login with your details

Forgot password? Click here to reset