DeepAI AI Chat
Log In Sign Up

Safety design concepts for statistical machine learning components toward accordance with functional safety standards

by   Akihisa Morikawa, et al.

In recent years, curial incidents and accidents have been reported due to un-intended control caused by misjudgment of statistical machine learning (SML), which include deep learning. The international functional safety standards for Electric/Electronic/Programmable (E/E/P) systems have been widely spread to improve safety. However, most of them do not recom-mended to use SML in safety critical systems so far. In practical the new concepts and methods are urgently required to enable SML to be safely used in safety critical systems. In this paper, we organize five kinds of technical safety concepts (TSCs) for SML components toward accordance with functional safety standards. We discuss not only quantitative evaluation criteria, but also development process based on XAI (eXplainable Artificial Intelligence) and Automotive SPICE to improve explainability and reliability in development phase. Fi-nally, we briefly compare the TSCs in cost and difficulty, and expect to en-courage further discussion in many communities and domain.


page 1

page 2

page 3

page 4


From Correlation to Causation: Formalizing Interpretable Machine Learning as a Statistical Process

Explainable AI (XAI) is a necessity in safety-critical systems such as i...

Design Assurance Evaluation of Microcontrollers for safety critical Avionics

Dealing with Commercial off-the-shelf (COTS) com- ponents is a daily bus...

An Optimized and Safety-aware Maintenance Framework: A Case Study on Aircraft Engine

The COVID-19 pandemic has recently exacerbated the fierce competition in...

Open Problems in Engineering and Quality Assurance of Safety Critical Machine Learning Systems

Fatal accidents are a major issue hindering the wide acceptance of safet...

Engineering Safety in Machine Learning

Machine learning algorithms are increasingly influencing our decisions a...