Is the Rush to Machine Learning Jeopardizing Safety? Results of a Survey

11/29/2021
by   Mehrnoosh Askarpour, et al.
0

Machine learning (ML) is finding its way into safety-critical systems (SCS). Current safety standards and practice were not designed to cope with ML techniques, and it is difficult to be confident that SCSs that contain ML components are safe. Our hypothesis was that there has been a rush to deploy ML techniques at the expense of a thorough examination as to whether the use of ML techniques introduces safety problems that we are not yet adequately able to detect and mitigate against. We thus conducted a targeted literature survey to determine the research effort that has been expended in applying ML to SCS compared with that spent on evaluating the safety of SCSs that deploy ML components. This paper presents the (surprising) results of the survey.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2021

Practical Machine Learning Safety: A Survey and Primer

The open-world deployment of Machine Learning (ML) algorithms in safety-...
research
09/28/2022

Toward Certification of Machine-Learning Systems for Low Criticality Airborne Applications

The exceptional progress in the field of machine learning (ML) in recent...
research
07/26/2021

How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review

Context: Machine Learning (ML) has been at the heart of many innovations...
research
05/10/2019

Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges

Machine learning has evolved into an enabling technology for a wide rang...
research
11/08/2022

Creating a Safety Assurance Case for an ML Satellite-Based Wildfire Detection and Alert System

Wildfires are a common problem in many areas of the world with often cat...
research
04/27/2023

Appropriateness is all you need!

The strive to make AI applications "safe" has led to the development of ...
research
05/03/2021

Learning by Design: Structuring and Documenting the Human Choices in Machine Learning Development

The influence of machine learning (ML) is quickly spreading, and a numbe...

Please sign up or login with your details

Forgot password? Click here to reset