Assurance Monitoring of Cyber-Physical Systems with Machine Learning Components

01/14/2020
by   Dimitrios Boursinos, et al.
40

Machine learning components such as deep neural networks are used extensively in Cyber-physical Systems (CPS). However, they may introduce new types of hazards that can have disastrous consequences and need to be addressed for engineering trustworthy systems. Although deep neural networks offer advanced capabilities, they must be complemented by engineering methods and practices that allow effective integration in CPS. In this paper, we investigate how to use the conformal prediction framework for assurance monitoring of CPS with machine learning components. In order to handle high-dimensional inputs in real-time, we compute nonconformity scores using embedding representations of the learned models. By leveraging conformal prediction the approach provides well-calibrated confidence and can allow monitoring that ensures a bounded small error rate while limiting the number of inputs for which an accurate prediction cannot be made. Empirical evaluation results using the German Traffic Sign Recognition Benchmark and a robot navigation dataset demonstrate that the error rates are well-calibrated while the number of alarms is small. The method is computationally efficient, and therefore, the approach is promising for assurance monitoring of CPS.

READ FULL TEXT

page 7

page 8

research
10/07/2021

Assurance Monitoring of Learning Enabled Cyber-Physical Systems Using Inductive Conformal Prediction based on Distance Learning

Machine learning components such as deep neural networks are used extens...
research
01/28/2020

Real-time Out-of-distribution Detection in Learning-Enabled Cyber-Physical Systems

Cyber-physical systems (CPS) greatly benefit by using machine learning c...
research
03/11/2020

Trusted Confidence Bounds for Learning Enabled Cyber-Physical Systems

Cyber-physical systems (CPS) can benefit by the use of learning enabled ...
research
10/07/2021

Improving Prediction Confidence in Learning-Enabled Autonomous Systems

Autonomous systems use extensively learning-enabled components such as d...
research
10/24/2017

Adapting Engineering Education to Industrie 4.0 Vision

Industrie 4.0 is originally a future vision described in the high-tech s...
research
07/19/2021

Accelerating deep neural networks for efficient scene understanding in automotive cyber-physical systems

Automotive Cyber-Physical Systems (ACPS) have attracted a significant am...
research
10/07/2021

Reliable Probability Intervals For Classification Using Inductive Venn Predictors Based on Distance Learning

Deep neural networks are frequently used by autonomous systems for their...

Please sign up or login with your details

Forgot password? Click here to reset