Value of structural health monitoring quantification in partially observable stochastic environments

12/28/2019
by   C. P. Andriotis, et al.
0

Sequential decision-making under uncertainty for optimal life-cycle control of deteriorating engineering systems and infrastructure entails two fundamental classes of decisions. The first class pertains to the various structural interventions, which can directly modify the existing properties of the system, while the second class refers to prescribing appropriate inspection and monitoring schemes, which are essential for updating our existing knowledge about the system states. The latter have to rely on quantifiable measures of efficiency, determined on the basis of objective criteria that, among others, consider the Value of Information (VoI) of different observational strategies, and the Value of Structural Health Monitoring (VoSHM) over the entire system life-cycle. In this work, we present general solutions for quantifying the VoI and VoSHM in partially observable stochastic domains, and although our definitions and methodology are general, we are particularly emphasizing and describing the role of Partially Observable Markov Decision Processes (POMDPs) in solving this problem, due to their advantageous theoretical and practical attributes in estimating arbitrarily well globally optimal policies. POMDP formulations are articulated for different structural environments having shared intervention actions but diversified inspection and monitoring options, thus enabling VoI and VoSHM estimation through their differentiated stochastic optimal control policies. POMDP solutions are derived using point-based solvers, which can efficiently approximate the POMDP value functions through Bellman backups at selected reachable points of the belief space. The suggested methodology is applied on stationary and non-stationary deteriorating environments, with both infinite and finite planning horizons, featuring single- or multi-component engineering systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2020

Optimal Inspection and Maintenance Planning for Deteriorating Structures through Dynamic Bayesian Networks and Markov Decision Processes

Civil and maritime engineering systems, among others, from bridges to of...
research
01/16/2013

Approximately Optimal Monitoring of Plan Preconditions

Monitoring plan preconditions can allow for replanning when a preconditi...
research
02/03/2022

A framework for quantifying the value of vibration-based structural health monitoring

The difficulty in quantifying the benefit of Structural Health Monitorin...
research
12/15/2022

Bridging POMDPs and Bayesian decision making for robust maintenance planning under model uncertainty: An application to railway systems

Structural Health Monitoring (SHM) describes a process for inferring qua...
research
03/12/2021

Value of information from vibration-based structural health monitoring extracted via Bayesian model updating

Quantifying the value of the information extracted from a structural hea...
research
02/25/2016

Thompson Sampling is Asymptotically Optimal in General Environments

We discuss a variant of Thompson sampling for nonparametric reinforcemen...
research
04/07/2018

Hindsight is Only 50/50: Unsuitability of MDP based Approximate POMDP Solvers for Multi-resolution Information Gathering

Partially Observable Markov Decision Processes (POMDPs) offer an elegant...

Please sign up or login with your details

Forgot password? Click here to reset