Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach

10/11/2016
by   John Duchi, et al.
0

We study statistical inference and robust solution methods for stochastic optimization problems, focusing on giving calibrated and adaptive confidence intervals for optimal values and solutions for a range of stochastic problems. As part of this, we develop a generalized empirical likelihood framework---based on distributional uncertainty sets constructed from nonparametric f-divergence balls---for Hadamard differentiable functionals, and in particular, stochastic optimization problems. As consequences of this theory, we provide principled methods of choosing distributional uncertainty regions so as to provide calibrated one- and two-sided confidence intervals. We also give an asymptotic expansion for our distributionally robust formulation, showing how robustification regularizes problems by their variance. Finally, we show that optimizers of the distributionally robust formulations we study enjoy (essentially) the same consistency properties as those in classical sample average approximations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2019

Admissibility of solution estimators for stochastic optimization

We look at stochastic optimization problems through the lens of statisti...
research
08/11/2021

Higher-Order Expansion and Bartlett Correctability of Distributionally Robust Optimization

Distributionally robust optimization (DRO) is a worst-case framework for...
research
10/20/2018

Learning Models with Uniform Performance via Distributionally Robust Optimization

A common goal in statistics and machine learning is to learn models that...
research
11/13/2020

Improving Offline Contextual Bandits with Distributional Robustness

This paper extends the Distributionally Robust Optimization (DRO) approa...
research
05/23/2023

Optimal Learning via Moderate Deviations Theory

This paper proposes a statistically optimal approach for learning a func...
research
01/04/2022

Stability and Sample-based Approximations of Composite Stochastic Optimization Problems

Optimization under uncertainty and risk is indispensable in many practic...
research
02/24/2022

Calibrated inference: statistical inference that accounts for both sampling uncertainty and distributional uncertainty

During data analysis, analysts often have to make seemingly arbitrary de...

Please sign up or login with your details

Forgot password? Click here to reset