Zeroth-Order Methods for Convex-Concave Minmax Problems: Applications to Decision-Dependent Risk Minimization

06/16/2021
by   Chinmay Maheshwari, et al.
5

Min-max optimization is emerging as a key framework for analyzing problems of robustness to strategically and adversarially generated data. We propose a random reshuffling-based gradient free Optimistic Gradient Descent-Ascent algorithm for solving convex-concave min-max problems with finite sum structure. We prove that the algorithm enjoys the same convergence rate as that of zeroth-order algorithms for convex minimization problems. We further specialize the algorithm to solve distributionally robust, decision-dependent learning problems, where gradient information is not readily available. Through illustrative simulations, we observe that our proposed approach learns models that are simultaneously robust against adversarial distribution shifts and strategic decisions from the data sources, and outperforms existing methods from the strategic classification literature.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2020

Sharp Analysis of Epoch Stochastic Gradient Descent Ascent Methods for Min-Max Optimization

Epoch gradient descent method (a.k.a. Epoch-GD) proposed by (Hazan and K...
research
10/06/2022

Accelerated Single-Call Methods for Constrained Min-Max Optimization

We study first-order methods for constrained min-max optimization. Exist...
research
05/25/2021

Saddle Point Optimization with Approximate Minimization Oracle and its Application to Robust Berthing Control

We propose an approach to saddle point optimization relying only on an o...
research
04/27/2021

Fast Distributionally Robust Learning with Variance Reduced Min-Max Optimization

Distributionally robust supervised learning (DRSL) is emerging as a key ...
research
02/22/2023

Distributionally Robust Recourse Action

A recourse action aims to explain a particular algorithmic decision by s...
research
07/03/2023

Coupled Gradient Flows for Strategic Non-Local Distribution Shift

We propose a novel framework for analyzing the dynamics of distribution ...
research
06/09/2023

Specifying and Solving Robust Empirical Risk Minimization Problems Using CVXPY

We consider robust empirical risk minimization (ERM), where model parame...

Please sign up or login with your details

Forgot password? Click here to reset