Towards Maximizing the Representation Gap between In-Domain & Out-of-Distribution Examples

10/20/2020
by   Jay Nandy, et al.
8

Among existing uncertainty estimation approaches, Dirichlet Prior Network (DPN) distinctly models different predictive uncertainty types. However, for in-domain examples with high data uncertainties among multiple classes, even a DPN model often produces indistinguishable representations from the out-of-distribution (OOD) examples, compromising their OOD detection performance. We address this shortcoming by proposing a novel loss function for DPN to maximize the representation gap between in-domain and OOD examples. Experimental results demonstrate that our proposed approach consistently improves OOD detection performance.

READ FULL TEXT

page 7

page 15

research
12/01/2021

Decomposing Representations for Deterministic Uncertainty Estimation

Uncertainty estimation is a key component in any deployed machine learni...
research
10/10/2019

Information Robust Dirichlet Networks for Predictive Uncertainty Estimation

Precise estimation of uncertainty in predictions for AI systems is a cri...
research
03/03/2023

Uncertainty Estimation by Fisher Information-based Evidential Deep Learning

Uncertainty estimation is a key factor that makes deep learning reliable...
research
10/24/2020

Uncertainty Aware Semi-Supervised Learning on Graph Data

Thanks to graph neural networks (GNNs), semi-supervised node classificat...
research
07/11/2022

DAUX: a Density-based Approach for Uncertainty eXplanations

Uncertainty quantification (UQ) is essential for creating trustworthy ma...
research
05/06/2022

Norm-Scaling for Out-of-Distribution Detection

Out-of-Distribution (OoD) inputs are examples that do not belong to the ...
research
02/13/2018

Learning Confidence for Out-of-Distribution Detection in Neural Networks

Modern neural networks are very powerful predictive models, but they are...

Please sign up or login with your details

Forgot password? Click here to reset