Deep Reinforcement Learning for Online Error Detection in Cyber-Physical Systems

02/03/2023
by   Seyyedamirhossein Saeidi, et al.
0

Reliability is one of the major design criteria in Cyber-Physical Systems (CPSs). This is because of the existence of some critical applications in CPSs and their failure is catastrophic. Therefore, employing strong error detection and correction mechanisms in CPSs is inevitable. CPSs are composed of a variety of units, including sensors, networks, and microcontrollers. Each of these units is probable to be in a faulty state at any time and the occurred fault can result in erroneous output. The fault may cause the units of CPS to malfunction and eventually crash. Traditional fault-tolerant approaches include redundancy time, hardware, information, and/or software. However, these approaches impose significant overheads besides their low error coverage, which limits their applicability. In addition, the interval between error occurrence and detection is too long in these approaches. In this paper, based on Deep Reinforcement Learning (DRL), a new error detection approach is proposed that not only detects errors with high accuracy but also can perform error detection at the moment due to very low inference time. The proposed approach can categorize different types of errors from normal data and predict whether the system will fail. The evaluation results illustrate that the proposed approach has improved more than 2x in terms of accuracy and more than 5x in terms of inference time compared to other approaches.

READ FULL TEXT

page 1

page 5

research
05/01/2018

Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning

With the rapid development of software and distributed computing, Cyber-...
research
02/03/2021

Exploring Fault Parameter Space using Reinforcement Learning-based Fault Injection

Assessing the safety of complex Cyber-Physical Systems (CPS) is a challe...
research
06/13/2019

Deep Reinforcement Learning for Cyber Security

The scale of Internet-connected systems has increased considerably, and ...
research
05/09/2021

Diagnosable-by-Design Model-Driven Development for IEC 61499 Industrial Cyber-Physical Systems

Integrating the design and creation of fault identification and diagnost...
research
07/14/2020

Robustifying Reinforcement Learning Agents via Action Space Adversarial Training

Adoption of machine learning (ML)-enabled cyber-physical systems (CPS) a...
research
05/31/2018

Root-cause Analysis for Time-series Anomalies via Spatiotemporal Graphical Modeling in Distributed Complex Systems

Performance monitoring, anomaly detection, and root-cause analysis in co...
research
11/27/2021

Artificial neural networks for online error detection

Hardware reliability is adversely affected by the downscaling of semicon...

Please sign up or login with your details

Forgot password? Click here to reset