UNIFY: a Unified Policy Designing Framework for Solving Constrained Optimization Problems with Machine Learning

10/25/2022
by   Mattia Silvestri, et al.
0

The interplay between Machine Learning (ML) and Constrained Optimization (CO) has recently been the subject of increasing interest, leading to a new and prolific research area covering (e.g.) Decision Focused Learning and Constrained Reinforcement Learning. Such approaches strive to tackle complex decision problems under uncertainty over multiple stages, involving both explicit (cost function, constraints) and implicit knowledge (from data), and possibly subject to execution time restrictions. While a good degree of success has been achieved, the existing methods still have limitations in terms of both applicability and effectiveness. For problems in this class, we propose UNIFY, a unified framework to design a solution policy for complex decision-making problems. Our approach relies on a clever decomposition of the policy in two stages, namely an unconstrained ML model and a CO problem, to take advantage of the strength of each approach while compensating for its weaknesses. With a little design effort, UNIFY can generalize several existing approaches, thus extending their applicability. We demonstrate the method effectiveness on two practical problems, namely an Energy Management System and the Set Multi-cover with stochastic coverage requirements. Finally, we highlight some current challenges of our method and future research directions that can benefit from the cross-fertilization of the two fields.

READ FULL TEXT
research
07/04/2022

Machine Learning in Access Control: A Taxonomy and Survey

An increasing body of work has recognized the importance of exploiting m...
research
07/11/2023

Score Function Gradient Estimation to Widen the Applicability of Decision-Focused Learning

Many real-world optimization problems contain unknown parameters that mu...
research
06/12/2022

A Survey on Uncertainty Reasoning and Quantification for Decision Making: Belief Theory Meets Deep Learning

An in-depth understanding of uncertainty is the first step to making eff...
research
06/17/2023

A Survey of Contextual Optimization Methods for Decision Making under Uncertainty

Recently there has been a surge of interest in operations research (OR) ...
research
02/21/2022

A Globally Convergent Evolutionary Strategy for Stochastic Constrained Optimization with Applications to Reinforcement Learning

Evolutionary strategies have recently been shown to achieve competing le...
research
10/04/2020

A Generative Machine Learning Approach to Policy Optimization in Pursuit-Evasion Games

We consider a pursuit-evasion game [11] played between two agents, 'Blue...
research
05/28/2019

NIL: Learning Nonlinear Interpolants

Nonlinear interpolants have been shown useful for the verification of pr...

Please sign up or login with your details

Forgot password? Click here to reset