Monte-Carlo optimizations for resource allocation problems in stochastic network systems

10/19/2012
by   Milos Hauskrecht, et al.
0

Real-world distributed systems and networks are often unreliable and subject to random failures of its components. Such a stochastic behavior affects adversely the complexity of optimization tasks performed routinely upon such systems, in particular, various resource allocation tasks. In this work we investigate and develop Monte Carlo solutions for a class of two-stage optimization problems in stochastic networks in which the expected value of resource allocations before and after stochastic failures needs to be optimized. The limitation of these problems is that their exact solutions are exponential in the number of unreliable network components: thus, exact methods do not scale-up well to large networks often seen in practice. We first prove that Monte Carlo optimization methods can overcome the exponential bottleneck of exact methods. Next we support our theoretical findings on resource allocation experiments and show a very good scale-up potential of the new methods to large stochastic networks.

READ FULL TEXT

page 1

page 2

page 4

page 7

research
05/21/2014

A Comparison of Monte Carlo Tree Search and Mathematical Optimization for Large Scale Dynamic Resource Allocation

Dynamic resource allocation (DRA) problems are an important class of dyn...
research
10/22/2021

Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP

Resource allocation problems in many computer systems can be formulated ...
research
04/13/2021

Don't Give Up on Large Optimization Problems; POP Them!

Resource allocation problems in many computer systems can be formulated ...
research
11/29/2018

Evolutionary framework for two-stage stochastic resource allocation problems

Resource allocation problems are a family of problems in which resources...
research
04/04/2022

Monte Carlo Physarum Machine: Characteristics of Pattern Formation in Continuous Stochastic Transport Networks

We present Monte Carlo Physarum Machine: a computational model suitable ...
research
07/19/2023

Priority-based DREAM Approach for Highly Manoeuvring Intruders in A Perimeter Defense Problem

In this paper, a Priority-based Dynamic REsource Allocation with decentr...

Please sign up or login with your details

Forgot password? Click here to reset