Optimizing the Performative Risk under Weak Convexity Assumptions

09/02/2022
by   Yulai Zhao, et al.
0

In performative prediction, a predictive model impacts the distribution that generates future data, a phenomenon that is being ignored in classical supervised learning. In this closed-loop setting, the natural measure of performance, denoted the performative risk, captures the expected loss incurred by a predictive model after deployment. The core difficulty of minimizing the performative risk is that the data distribution itself depends on the model parameters. This dependence is governed by the environment and not under the control of the learner. As a consequence, even the choice of a convex loss function can result in a highly non-convex performative risk minimization problem. Prior work has identified a pair of general conditions on the loss and the mapping from model parameters to distributions that implies convexity of the performative risk. In this paper, we relax these assumptions and focus on obtaining weaker notions of convexity, without sacrificing the amenability of the performative risk minimization problem for iterative optimization methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/14/2023

Performative Prediction with Neural Networks

Performative prediction is a framework for learning models that influenc...
research
02/17/2021

Outside the Echo Chamber: Optimizing the Performative Risk

In performative prediction, predictions guide decision-making and hence ...
research
06/30/2021

Which Echo Chamber? Regions of Attraction in Learning with Decision-Dependent Distributions

As data-driven methods are deployed in real-world settings, the processe...
research
12/04/2020

Non-Asymptotic Analysis of Excess Risk via Empirical Risk Landscape

In this paper, we provide a unified analysis of the excess risk of the m...
research
01/05/2019

Analysis of a Two-Layer Neural Network via Displacement Convexity

Fitting a function by using linear combinations of a large number N of `...
research
02/07/2014

Binary Excess Risk for Smooth Convex Surrogates

In statistical learning theory, convex surrogates of the 0-1 loss are hi...
research
12/16/2013

Probable convexity and its application to Correlated Topic Models

Non-convex optimization problems often arise from probabilistic modeling...

Please sign up or login with your details

Forgot password? Click here to reset