DeepGuard: A Framework for Safeguarding Autonomous Driving Systems from Inconsistent Behavior

11/18/2021
by   Manzoor Hussain, et al.
2

The deep neural networks (DNNs)based autonomous driving systems (ADSs) are expected to reduce road accidents and improve safety in the transportation domain as it removes the factor of human error from driving tasks. The DNN based ADS sometimes may exhibit erroneous or unexpected behaviors due to unexpected driving conditions which may cause accidents. It is not possible to generalize the DNN model performance for all driving conditions. Therefore, the driving conditions that were not considered during the training of the ADS may lead to unpredictable consequences for the safety of autonomous vehicles. This study proposes an autoencoder and time series analysis based anomaly detection system to prevent the safety critical inconsistent behavior of autonomous vehicles at runtime. Our approach called DeepGuard consists of two components. The first component, the inconsistent behavior predictor, is based on an autoencoder and time series analysis to reconstruct the driving scenarios. Based on reconstruction error and threshold it determines the normal and unexpected driving scenarios and predicts potential inconsistent behavior. The second component provides on the fly safety guards, that is, it automatically activates healing strategies to prevent inconsistencies in the behavior. We evaluated the performance of DeepGuard in predicting the injected anomalous driving scenarios using already available open sourced DNN based ADSs in the Udacity simulator. Our simulation results show that the best variant of DeepGuard can predict up to 93 percent on the CHAUFFEUR ADS, 83 percent on DAVE2 ADS, and 80 percent of inconsistent behavior on the EPOCH ADS model, outperforming SELFORACLE and DeepRoad. Overall, DeepGuard can prevent up to 89 percent of all predicted inconsistent behaviors of ADS by executing predefined safety guards.

READ FULL TEXT

page 1

page 5

page 10

page 11

page 12

page 16

research
10/10/2019

Misbehaviour Prediction for Autonomous Driving Systems

Deep Neural Networks (DNNs) are the core component of modern autonomous ...
research
05/29/2020

Reducing DNN Labelling Cost using Surprise Adequacy: An Industrial Case Study for Autonomous Driving

Deep Neural Networks (DNNs) are rapidly being adopted by the automotive ...
research
03/22/2020

Guardauto: A Decentralized Runtime Protection System for Autonomous Driving

Due to the broad attack surface and the lack of runtime protection, pote...
research
09/12/2022

Understanding Time Variations of DNN Inference in Autonomous Driving

Deep neural networks (DNNs) are widely used in autonomous driving due to...
research
12/29/2021

Multi-Adversarial Safety Analysis for Autonomous Vehicles

This work in progress considers reachability-based safety analysis in th...
research
08/02/2023

A Counterfactual Safety Margin Perspective on the Scoring of Autonomous Vehicles' Riskiness

Autonomous Vehicles (AVs) have the potential to provide numerous societa...
research
04/04/2023

PAC-Based Formal Verification for Out-of-Distribution Data Detection

Cyber-physical systems (CPS) like autonomous vehicles, that utilize lear...

Please sign up or login with your details

Forgot password? Click here to reset