Optimal Control of Multiclass Fluid Queueing Networks: A Machine Learning Approach

07/23/2023
by   Dimitris Bertsimas, et al.
0

We propose a machine learning approach to the optimal control of multiclass fluid queueing networks (MFQNETs) that provides explicit and insightful control policies. We prove that a threshold type optimal policy exists for MFQNET control problems, where the threshold curves are hyperplanes passing through the origin. We use Optimal Classification Trees with hyperplane splits (OCT-H) to learn an optimal control policy for MFQNETs. We use numerical solutions of MFQNET control problems as a training set and apply OCT-H to learn explicit control policies. We report experimental results with up to 33 servers and 99 classes that demonstrate that the learned policies achieve 100% accuracy on the test set. While the offline training of OCT-H can take days in large networks, the online application takes milliseconds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2019

Explicit stabilized integrators for stiff optimal control problems

Explicit stabilized methods are an efficient alternative to implicit sch...
research
03/03/2021

Policy Decomposition: Approximate Optimal Control with Suboptimality Estimates

Numerically computing global policies to optimal control problems for co...
research
05/19/2022

CAMEO: Curiosity Augmented Metropolis for Exploratory Optimal Policies

Reinforcement Learning has drawn huge interest as a tool for solving opt...
research
08/03/2016

Efficient Optimal Control of Smoke using Spacetime Multigrid

We present a novel algorithm to control the physically-based animation o...
research
03/29/2022

Search Methods for Policy Decompositions

Computing optimal control policies for complex dynamical systems require...
research
01/13/2020

On the synthesis of control policies from noisy example datasets: a probabilistic approach

In this note we consider the problem of synthesizing optimal control pol...
research
07/09/2021

Structured Hammerstein-Wiener Model Learning for Model Predictive Control

This paper aims to improve the reliability of optimal control using mode...

Please sign up or login with your details

Forgot password? Click here to reset