Evidential Turing Processes

06/02/2021
by   Melih Kandemir, et al.
0

A probabilistic classifier with reliable predictive uncertainties i) fits successfully to the target domain data, ii) provides calibrated class probabilities in difficult regions of the target domain (e.g. class overlap), and iii) accurately identifies queries coming out of the target domain and reject them. We introduce an original combination of evidential deep learning, neural processes, and neural Turing machines capable of providing all three essential properties mentioned above for total uncertainty quantification. We observe our method on three image classification benchmarks and two neural net architectures to consistently give competitive or superior scores with respect to multiple uncertainty quantification metrics against state-of-the-art methods explicitly tailored to one or a few of them. Our unified solution delivers an implementation-friendly and computationally efficient recipe for safety clearance and provides intellectual economy to an investigation of algorithmic roots of epistemic awareness in deep neural nets.

READ FULL TEXT

page 8

page 16

research
08/24/2020

SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimates

Uncertainty quantification is a fundamental yet unsolved problem for dee...
research
12/14/2022

Post-hoc Uncertainty Learning using a Dirichlet Meta-Model

It is known that neural networks have the problem of being over-confiden...
research
09/17/2022

Sample-based Uncertainty Quantification with a Single Deterministic Neural Network

Development of an accurate, flexible, and numerically efficient uncertai...
research
07/09/2020

Uncertainty Quantification in Deep Residual Neural Networks

Uncertainty quantification is an important and challenging problem in de...
research
12/29/2020

Uncertainty-Wizard: Fast and User-Friendly Neural Network Uncertainty Quantification

Uncertainty and confidence have been shown to be useful metrics in a wid...
research
04/13/2022

Better Uncertainty Quantification for Machine Translation Evaluation

Neural-based machine translation (MT) evaluation metrics are progressing...

Please sign up or login with your details

Forgot password? Click here to reset