Notes on the Behavior of MC Dropout

08/06/2020
by   Francesco Verdoja, et al.
0

Among the various options to estimate uncertainty in deep neural networks, Monte-Carlo dropout is widely popular for its simplicity and effectiveness. However the quality of the uncertainty estimated through this method varies and choices in architecture design and in training procedures have to be carefully considered and tested to obtain satisfactory results. In this paper we present a study offering a different point of view on the behavior of Monte-Carlo dropout, which enables us to observe a few interesting properties of the technique to keep in mind when considering its use for uncertainty estimation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2020

Qualitative Analysis of Monte Carlo Dropout

In this report, we present qualitative analysis of Monte Carlo (MC) drop...
research
12/02/2021

Quantifying the uncertainty of neural networks using Monte Carlo dropout for deep learning based quantitative MRI

Dropout is conventionally used during the training phase as regularizati...
research
05/12/2018

Predictive Uncertainty in Large Scale Classification using Dropout - Stochastic Gradient Hamiltonian Monte Carlo

Predictive uncertainty is crucial for many computer vision tasks, from i...
research
05/24/2023

Sampling-based Uncertainty Estimation for an Instance Segmentation Network

The examination of uncertainty in the predictions of machine learning (M...
research
02/18/2019

Detecting and Diagnosing Incipient Building Faults Using Uncertainty Information from Deep Neural Networks

Early detection of incipient faults is of vital importance to reducing m...
research
07/24/2021

μDARTS: Model Uncertainty-Aware Differentiable Architecture Search

We present a Model Uncertainty-aware Differentiable ARchiTecture Search ...
research
07/20/2020

Monte Carlo Dropout Ensembles for Robust Illumination Estimation

Computational color constancy is a preprocessing step used in many camer...

Please sign up or login with your details

Forgot password? Click here to reset