Decision Automation for Electric Power Network Recovery

10/01/2019
by   Yugandhar Sarkale, et al.
0

Critical infrastructure systems such as electric power networks, water networks, and transportation systems play a major role in the welfare of any community. In the aftermath of disasters, their recovery is of paramount importance; orderly and efficient recovery involves the assignment of limited resources (a combination of human repair workers and machines) to repair damaged infrastructure components. The decision maker must also deal with uncertainty in the outcome of the resource-allocation actions during recovery. The manual assignment of resources seldom is optimal despite the expertise of the decision maker because of the large number of choices and uncertainties in consequences of sequential decisions. This combinatorial assignment problem under uncertainty is known to be NP-hard. We propose a novel decision technique that addresses the massive number of decision choices for large-scale real-world problems; in addition, our method also features an experiential learning component that adaptively determines the utilization of the computational resources based on the performance of a small number of choices. Our framework is closed-loop, and naturally incorporates all the attractive features of such a decision-making system. In contrast to myopic approaches, which do not account for the future effects of the current choices, our methodology has an anticipatory learning component that effectively incorporates lookahead into the solutions. To this end, we leverage the theory of regression analysis, Markov decision processes (MDPs), multi-armed bandits, and stochastic models of community damage from natural disasters to develop a method for near-optimal recovery of communities. Our method contributes to the general problem of MDPs with massive action spaces with application to recovery of communities affected by hazards.

READ FULL TEXT

Authors

page 1

page 2

03/12/2018

Solving Markov decision processes for network-level post-hazard recovery via simulation optimization and rollout

Computation of optimal recovery decisions for community resilience assur...
03/05/2018

Near-optimal planning using approximate dynamic programming to enhance post-hazard community resilience management

The lack of a comprehensive decision-making approach at the community-le...
06/22/2018

An Approximate Dynamic Programming Approach to Community Recovery Management (Extended Abstract)

The functioning of interdependent civil infrastructure systems in the af...
07/27/2014

MDPs with Unawareness

Markov decision processes (MDPs) are widely used for modeling decision-m...
04/01/2018

A Modified Approximate Dynamic Programming Algorithm for Community-level Food Security Following Disasters

In the aftermath of an extreme natural hazard, community residents must ...
07/12/2020

Deep Learning-based Resource Allocation for Infrastructure Resilience

From an optimization point of view, resource allocation is one of the co...
04/25/2019

DeepPR: Incremental Recovery for Interdependent VNFs with Deep Reinforcement Learning

The increasing reliance upon cloud services entails more flexible networ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.