Igeood: An Information Geometry Approach to Out-of-Distribution Detection

Reliable out-of-distribution (OOD) detection is fundamental to implementing safer modern machine learning (ML) systems. In this paper, we introduce Igeood, an effective method for detecting OOD samples. Igeood applies to any pre-trained neural network, works under various degrees of access to the ML model, does not require OOD samples or assumptions on the OOD data but can also benefit (if available) from OOD samples. By building on the geodesic (Fisher-Rao) distance between the underlying data distributions, our discriminator can combine confidence scores from the logits outputs and the learned features of a deep neural network. Empirically, we show that Igeood outperforms competing state-of-the-art methods on a variety of network architectures and datasets.

READ FULL TEXT
research
06/08/2017

Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks

We consider the problem of detecting out-of-distribution images in neura...
research
06/29/2021

Certifiable Machine Unlearning for Linear Models

Machine unlearning is the task of updating machine learning (ML) models ...
research
03/07/2020

A Post-processing Method for Detecting Unknown Intent of Dialogue System via Pre-trained Deep Neural Network Classifier

With the maturity and popularity of dialogue systems, detecting user's u...
research
09/25/2019

Probabilistic Modeling of Deep Features for Out-of-Distribution and Adversarial Detection

We present a principled approach for detecting out-of-distribution (OOD)...
research
12/28/2019

Detecting Out-of-Distribution Examples with In-distribution Examples and Gram Matrices

When presented with Out-of-Distribution (OOD) examples, deep neural netw...
research
06/11/2020

NADS: Neural Architecture Distribution Search for Uncertainty Awareness

Machine learning (ML) systems often encounter Out-of-Distribution (OoD) ...
research
02/23/2023

An efficient method for Out-of-Distribution Detection

Detecting out-of-distribution (OOD) data is critical to building reliabl...

Please sign up or login with your details

Forgot password? Click here to reset