Constrained optimization under uncertainty for decision-making problems: Application to Real-Time Strategy games

01/03/2019
by   Valentin Antuori, et al.
0

Decision-making problems can be modeled as combinatorial optimization problems with Constraint Programming formalisms such as Constrained Optimization Problems. However, few Constraint Programming formalisms can deal with both optimization and uncertainty at the same time, and none of them are convenient to model problems we tackle in this paper. Here, we propose a way to deal with combinatorial optimization problems under uncertainty within the classical Constrained Optimization Problems formalism by injecting the Rank Dependent Utility from decision theory. We also propose a proof of concept of our method to show it is implementable and can solve concrete decision-making problems using a regular constraint solver, and propose a bot that won the partially observable track of the 2018 μRTS AI competition. Our result shows it is possible to handle uncertainty with regular Constraint Programming solvers, without having to define a new formalism neither to develop dedicated solvers. This brings new perspective to tackle uncertainty in Constraint Programming.

READ FULL TEXT
research
06/22/2020

Constrained Combinatorial Optimization with Reinforcement Learning

This paper presents a framework to tackle constrained combinatorial opti...
research
07/15/2021

USCO-Solver: Solving Undetermined Stochastic Combinatorial Optimization Problems

Real-world decision-making systems are often subject to uncertainties th...
research
05/22/2020

microPhantom: Playing microRTS under uncertainty and chaos

This competition paper presents microPhantom, a bot playing to microRTS ...
research
05/22/2009

Scenario-based Stochastic Constraint Programming

To model combinatorial decision problems involving uncertainty and proba...
research
10/20/2022

A general model-and-run solver for multistage robust discrete linear optimization

The necessity to deal with uncertain data is a major challenge in decisi...
research
09/01/2020

PYCSP3: Modeling Combinatorial Constrained Problems in Python

In this document, we introduce PYCSP3, a Python library that allows us t...
research
07/03/2019

Co-training for Policy Learning

We study the problem of learning sequential decision-making policies in ...

Please sign up or login with your details

Forgot password? Click here to reset