Branch Learn with Post-hoc Correction for Predict+Optimize with Unknown Parameters in Constraints

03/12/2023
by   Xinyi Hu, et al.
0

Combining machine learning and constrained optimization, Predict+Optimize tackles optimization problems containing parameters that are unknown at the time of solving. Prior works focus on cases with unknowns only in the objectives. A new framework was recently proposed to cater for unknowns also in constraints by introducing a loss function, called Post-hoc Regret, that takes into account the cost of correcting an unsatisfiable prediction. Since Post-hoc Regret is non-differentiable, the previous work computes only its approximation. While the notion of Post-hoc Regret is general, its specific implementation is applicable to only packing and covering linear programming problems. In this paper, we first show how to compute Post-hoc Regret exactly for any optimization problem solvable by a recursive algorithm satisfying simple conditions. Experimentation demonstrates substantial improvement in the quality of solutions as compared to the earlier approximation approach. Furthermore, we show experimentally the empirical behavior of different combinations of correction and penalty functions used in the Post-hoc Regret of the same benchmarks. Results provide insights for defining the appropriate Post-hoc Regret in different application scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2022

Predict+Optimize for Packing and Covering LPs with Unknown Parameters in Constraints

Predict+Optimize is a recently proposed framework which combines machine...
research
05/01/2022

Branch Learn for Recursively and Iteratively Solvable Problems in Predict+Optimize

This paper proposes Branch Learn, a framework for Predict+Optimize t...
research
06/15/2018

The Limits of Post-Selection Generalization

While statistics and machine learning offers numerous methods for ensuri...
research
07/30/2023

You Shall not Pass: the Zero-Gradient Problem in Predict and Optimize for Convex Optimization

Predict and optimize is an increasingly popular decision-making paradigm...
research
10/27/2022

Regret Bounds and Experimental Design for Estimate-then-Optimize

In practical applications, data is used to make decisions in two steps: ...
research
10/06/2021

Post-hoc Models for Performance Estimation of Machine Learning Inference

Estimating how well a machine learning model performs during inference i...
research
06/04/2023

(Un)reasonable Allure of Ante-hoc Interpretability for High-stakes Domains: Transparency Is Necessary but Insufficient for Explainability

Ante-hoc interpretability has become the holy grail of explainable machi...

Please sign up or login with your details

Forgot password? Click here to reset