A Surrogate Objective Framework for Prediction+Optimization with Soft Constraints

11/22/2021
by   Kai Yan, et al.
0

Prediction+optimization is a common real-world paradigm where we have to predict problem parameters before solving the optimization problem. However, the criteria by which the prediction model is trained are often inconsistent with the goal of the downstream optimization problem. Recently, decision-focused prediction approaches, such as SPO+ and direct optimization, have been proposed to fill this gap. However, they cannot directly handle the soft constraints with the max operator required in many real-world objectives. This paper proposes a novel analytically differentiable surrogate objective framework for real-world linear and semi-definite negative quadratic programming problems with soft linear and non-negative hard constraints. This framework gives the theoretical bounds on constraints' multipliers, and derives the closed-form solution with respect to predictive parameters and thus gradients for any variable in the problem. We evaluate our method in three applications extended with soft constraints: synthetic linear programming, portfolio optimization, and resource provisioning, demonstrating that our method outperforms traditional two-staged methods and other decision-focused approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2023

Score Function Gradient Estimation to Widen the Applicability of Decision-Focused Learning

Many real-world optimization problems contain unknown parameters that mu...
research
06/15/2022

Online Contextual Decision-Making with a Smart Predict-then-Optimize Method

We study an online contextual decision-making problem with resource cons...
research
10/22/2017

Smart "Predict, then Optimize"

Many real-world analytics problems involve two significant challenges: p...
research
11/11/2022

Extended Formulations via Decision Diagrams

We propose a general algorithm of constructing an extended formulation f...
research
12/02/2022

Predict-and-Critic: Accelerated End-to-End Predictive Control for Cloud Computing through Reinforcement Learning

Cloud computing holds the promise of reduced costs through economies of ...
research
02/14/2022

Scaling up Ranking under Constraints for Live Recommendations by Replacing Optimization with Prediction

Many important multiple-objective decision problems can be cast within t...

Please sign up or login with your details

Forgot password? Click here to reset