A mixed-integer programming model for identifying intuitive ambulance dispatching policies

02/18/2022
by   Laura A. Albert, et al.
0

Markov decision process models and algorithms can be used to identify optimal policies for dispatching ambulances to spatially distributed customers, where the optimal policies indicate the ambulance to dispatch to each customer type in each state. Since the optimal solutions are dependent on Markov state variables, they may not always correspond to a simple set of rules when implementing the policies in practice. Restricted policies that conform to a priority list for each type of customer may be desirable for use in practice, since such policies are transparent and easy to implement. A priority list policy is an ordered list of ambulances that indicates the preferred order to dispatch the ambulances to a customer type subject to ambulance availability. This paper proposes a constrained Markov decision process model for identifying optimal priority list policies that is formulated as a mixed integer programming model, does not extend the Markov state space, and can be solved using standard algorithms. A series of computational examples illustrate the approach. The optimal mixed integer programming solutions to the computational examples have objective function values that are close to those of the unrestricted model and are superior to those of heuristics.

READ FULL TEXT
research
01/16/2014

An Investigation into Mathematical Programming for Finite Horizon Decentralized POMDPs

Decentralized planning in uncertain environments is a complex task gener...
research
08/03/2022

Bayesian regularization of empirical MDPs

In most applications of model-based Markov decision processes, the param...
research
02/27/2020

Learning Optimal Temperature Region for Solving Mixed Integer Functional DCOPs

Distributed Constraint Optimization Problems (DCOPs) are an important fr...
research
11/27/2016

Verifying Integer Programming Results

Software for mixed-integer linear programming can return incorrect resul...
research
03/21/2023

Multi-Robot Planning on Dynamic Topological Graphs using Mixed-Integer Programming

Planning for multi-robot teams in complex environments is a challenging ...
research
07/16/2020

Strengthening Deterministic Policies for POMDPs

The synthesis problem for partially observable Markov decision processes...
research
09/30/2022

Prioritizing emergency evacuations under compounding levels of uncertainty

Well-executed emergency evacuations can save lives and reduce suffering....

Please sign up or login with your details

Forgot password? Click here to reset