A causal model of safety assurance for machine learning

01/14/2022
by   Simon Burton, et al.
0

This paper proposes a framework based on a causal model of safety upon which effective safety assurance cases for ML-based applications can be built. In doing so, we build upon established principles of safety engineering as well as previous work on structuring assurance arguments for ML. The paper defines four categories of safety case evidence and a structured analysis approach within which these evidences can be effectively combined. Where appropriate, abstract formalisations of these contributions are used to illustrate the causalities they evaluate, their contributions to the safety argument and desirable properties of the evidences. Based on the proposed framework, progress in this area is re-evaluated and a set of future research directions proposed in order for tangible progress in this field to be made.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/28/2021

Unsolved Problems in ML Safety

Machine learning (ML) systems are rapidly increasing in size, are acquir...
research
01/29/2021

Safety Case Templates for Autonomous Systems

This report documents safety assurance argument templates to support the...
research
09/01/2021

The Role of Explainability in Assuring Safety of Machine Learning in Healthcare

Established approaches to assuring safety-critical systems and software ...
research
11/08/2022

Creating a Safety Assurance Case for an ML Satellite-Based Wildfire Detection and Alert System

Wildfires are a common problem in many areas of the world with often cat...
research
09/08/2023

Down the Toxicity Rabbit Hole: Investigating PaLM 2 Guardrails

This paper conducts a robustness audit of the safety feedback of PaLM 2 ...
research
08/19/2020

Machine Learning for Reliability Engineering and Safety Applications: Review of Current Status and Future Opportunities

Machine learning (ML) pervades an increasing number of academic discipli...
research
10/30/2020

Waymo's Safety Methodologies and Safety Readiness Determinations

Waymo's safety methodologies, which draw on well established engineering...

Please sign up or login with your details

Forgot password? Click here to reset