Incorporating Epistemic Uncertainty into the Safety Assurance of Socio-Technical Systems

10/10/2017
by   Chris Leong, et al.
0

In system development, epistemic uncertainty is an ever-present possibility when reasoning about the causal factors during hazard analysis. Such uncertainty is common when complicated systems interact with one another, and it is dangerous because it impairs hazard analysis and thus increases the chance of overlooking unsafe situations. Uncertainty around causation thus needs to be managed well. Unfortunately, existing hazard analysis techniques tend to ignore unknown uncertainties, and system stakeholders rarely track known uncertainties well through the system lifecycle. In this paper, we outline an approach to managing epistemic uncertainty in existing hazard analysis techniques by focusing on known and unknown uncertainty. We have created a reference populated with a wide range of safety-critical causal relationships to recognise unknown uncertainty, and we have developed a model to systematically capture and track known uncertainty around such factors. We have also defined a process for using the reference and model to assess possible causal factors that are suspected during hazard analysis. To assess the applicability of our approach, we have analysed the widely-used MoDAF architectural model and determined that there is potential for our approach to identify additional causal factors that are not apparent from individual MoDAF views. We have also reviewed an existing safety assessment example (the ARP4761 Aircraft System analysis) and determined that our approach could indeed be incorporated into that process. We have also integrated our approach into the STPA hazard analysis technique to demonstrate its feasibility to incorporate into existing techniques. It is therefore plausible that our approach can increase safety assurance provided by hazard analysis in the face of epistemic uncertainty.

READ FULL TEXT

page 5

page 9

page 10

research
05/20/2022

The Unreasonable Effectiveness of Deep Evidential Regression

There is a significant need for principled uncertainty reasoning in mach...
research
04/18/2019

Safety-margin-based design and redesign considering mixed epistemic model uncertainty and aleatory parameter uncertainty

At the initial design stage engineers often rely on low-fidelity models ...
research
09/11/2023

Mind the Uncertainty: Risk-Aware and Actively Exploring Model-Based Reinforcement Learning

We introduce a simple but effective method for managing risk in model-ba...
research
10/06/2020

Real-time Uncertainty Decomposition for Online Learning Control

Safety-critical decisions based on machine learning models require a cle...
research
04/13/2021

Multivariate Deep Evidential Regression

There is significant need for principled uncertainty reasoning in machin...
research
02/17/2023

Learning to Forecast Aleatoric and Epistemic Uncertainties over Long Horizon Trajectories

Giving autonomous agents the ability to forecast their own outcomes and ...
research
12/26/2020

Bayesian Inductive Learner for Graph Resiliency under uncertainty

In the quest to improve efficiency, interdependence and complexity are b...

Please sign up or login with your details

Forgot password? Click here to reset