Quantifying Uncertainty from Different Sources in Deep Neural Networks for Image Classification

11/17/2020
by   Aria Khoshsirat, et al.
17

Quantifying uncertainty in a model's predictions is important as it enables, for example, the safety of an AI system to be increased by acting on the model's output in an informed manner. We cannot expect a system to be 100 accurate or perfect at its task, however, we can equip the system with some tools to inform us if it is not certain about a prediction. This way, a second check can be performed, or the task can be passed to a human specialist. This is crucial for applications where the cost of an error is high, such as in autonomous vehicle control, medical image analysis, financial estimations or legal fields. Deep Neural Networks are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in DNNs is a challenging and yet on-going problem. Although there have been many efforts to equip NNs with tools to estimate uncertainty, such as Monte Carlo Dropout, most of the previous methods only focus on one of the three types of model, data or distributional uncertainty. In this paper we propose a complete framework to capture and quantify all of these three types of uncertainties in DNNs for image classification. This framework includes an ensemble of CNNs for model uncertainty, a supervised reconstruction auto-encoder to capture distributional uncertainty and using the output of activation functions in the last layer of the network, to capture data uncertainty. Finally we demonstrate the efficiency of our method on popular image datasets for classification.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 9

page 10

page 11

page 12

page 15

06/01/2021

Quantifying Predictive Uncertainty in Medical Image Analysis with Deep Kernel Learning

Deep neural networks are increasingly being used for the analysis of med...
02/28/2018

Predictive Uncertainty Estimation via Prior Networks

Estimating uncertainty is important to improving the safety of AI system...
07/28/2021

Uncertainty-Aware Credit Card Fraud Detection Using Deep Learning

Countless research works of deep neural networks (DNNs) in the task of c...
07/07/2021

A Survey of Uncertainty in Deep Neural Networks

Due to their increasing spread, confidence in neural network predictions...
02/11/2020

Validating uncertainty in medical image translation

Medical images are increasingly used as input to deep neural networks to...
10/15/2019

Quantifying Classification Uncertainty using Regularized Evidential Neural Networks

Traditional deep neural nets (NNs) have shown the state-of-the-art perfo...
06/11/2019

Quantifying Intrinsic Uncertainty in Classification via Deep Dirichlet Mixture Networks

With the widespread success of deep neural networks in science and techn...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.