Smart "Predict, then Optimize"

10/22/2017
by   Adam N. Elmachtoub, et al.
0

Many real-world analytics problems involve two significant challenges: prediction and optimization. Due to the typically complex nature of each challenge, the standard paradigm is to predict, then optimize. By and large, machine learning tools are intended to minimize prediction error and do not account for how the predictions will be used in a downstream optimization problem. In contrast, we propose a new and very general framework, called Smart "Predict, then Optimize" (SPO), which directly leverages the optimization problem structure, i.e., its objective and constraints, for designing successful analytics tools. A key component of our framework is the SPO loss function, which measures the quality of a prediction by comparing the objective values of the solutions generated using the predicted and observed parameters, respectively. Training a model with respect to the SPO loss is computationally challenging, and therefore we also develop a surrogate loss function, called the SPO+ loss, which upper bounds the SPO loss, has desirable convexity properties, and is statistically consistent under mild conditions. We also propose a stochastic gradient descent algorithm which allows for situations in which the number of training samples is large, model regularization is desired, and/or the optimization problem of interest is nonlinear or integer. Finally, we perform computational experiments to empirically verify the success of our SPO framework in comparison to the standard predict-then-optimize approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/27/2019

Generalization Bounds in the Predict-then-Optimize Framework

The predict-then-optimize framework is fundamental in many practical set...
research
07/30/2023

You Shall not Pass: the Zero-Gradient Problem in Predict and Optimize for Convex Optimization

Predict and optimize is an increasingly popular decision-making paradigm...
research
12/07/2021

Predict and Optimize: Through the Lens of Learning to Rank

In the last years predict-and-optimize approaches (Elmachtoub and Grigas...
research
11/15/2022

Decision-Aware Learning for Optimizing Health Supply Chains

We study the problem of allocating limited supply of medical resources i...
research
04/14/2022

Gradient boosting for convex cone predict and optimize problems

Many problems in engineering and statistics involve both predictive fore...
research
06/28/2022

PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programming

In deterministic optimization, it is typically assumed that all paramete...
research
11/22/2021

A Surrogate Objective Framework for Prediction+Optimization with Soft Constraints

Prediction+optimization is a common real-world paradigm where we have to...

Please sign up or login with your details

Forgot password? Click here to reset