DeepAI AI Chat
Log In Sign Up

Evaluating Uncertainty Quantification in End-to-End Autonomous Driving Control

by   Rhiannon Michelmore, et al.

A rise in popularity of Deep Neural Networks (DNNs), attributed to more powerful GPUs and widely available datasets, has seen them being increasingly used within safety-critical domains. One such domain, self-driving, has benefited from significant performance improvements, with millions of miles having been driven with no human intervention. Despite this, crashes and erroneous behaviours still occur, in part due to the complexity of verifying the correctness of DNNs and a lack of safety guarantees. In this paper, we demonstrate how quantitative measures of uncertainty can be extracted in real-time, and their quality evaluated in end-to-end controllers for self-driving cars. To this end we utilise a recent method for gathering approximate uncertainty information from DNNs without changing the network's architecture. We propose evaluation techniques for the uncertainty on two separate architectures which use the uncertainty to predict crashes up to five seconds in advance. We find that mutual information, a measure of uncertainty in classification networks, is a promising indicator of forthcoming crashes.


page 4

page 5


Uncertainty Quantification with Statistical Guarantees in End-to-End Autonomous Driving Control

Deep neural network controllers for autonomous driving have recently ben...

A Comparison of Uncertainty Estimation Approaches in Deep Learning Components for Autonomous Vehicle Applications

A key to ensuring safety in Autonomous Vehicles (AVs) is to avoid any ab...

Interval Deep Learning for Uncertainty Quantification in Safety Applications

Deep neural networks (DNNs) are becoming more prevalent in important saf...

Misbehaviour Prediction for Autonomous Driving Systems

Deep Neural Networks (DNNs) are the core component of modern autonomous ...

Uncertainty Quantification and Resource-Demanding Computer Vision Applications of Deep Learning

Bringing deep neural networks (DNNs) into safety critical applications s...

Positive Trust Balance for Self-Driving Car Deployment

The crucial decision about when self-driving cars are ready to deploy is...

Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Driving

In this paper, we show how uncertainty estimation can be leveraged to en...