Detecting Out-of-Distribution Inputs in Deep Neural Networks Using an Early-Layer Output

10/23/2019
by   Vahdat Abdelzad, et al.
0

Deep neural networks achieve superior performance in challenging tasks such as image classification. However, deep classifiers tend to incorrectly classify out-of-distribution (OOD) inputs, which are inputs that do not belong to the classifier training distribution. Several approaches have been proposed to detect OOD inputs, but the detection task is still an ongoing challenge. In this paper, we propose a new OOD detection approach that can be easily applied to an existing classifier and does not need to have access to OOD samples. The detector is a one-class classifier trained on the output of an early layer of the original classifier fed with its original training set. We apply our approach to several low- and high-dimensional datasets and compare it to the state-of-the-art detection approaches. Our approach achieves substantially better results over multiple metrics.

READ FULL TEXT
research
02/08/2023

Robustness to Spurious Correlations Improves Semantic Out-of-Distribution Detection

Methods which utilize the outputs or feature representations of predicti...
research
02/05/2018

A Method for Restoring the Training Set Distribution in an Image Classifier

Convolutional Neural Networks are a well-known staple of modern image cl...
research
02/22/2022

Model2Detector: Widening the Information Bottleneck for Out-of-Distribution Detection using a Handful of Gradient Steps

Out-of-distribution detection is an important capability that has long e...
research
09/17/2022

Inducing Early Neural Collapse in Deep Neural Networks for Improved Out-of-Distribution Detection

We propose a simple modification to standard ResNet architectures–L2 reg...
research
09/26/2022

Out-of-Distribution Detection with Hilbert-Schmidt Independence Optimization

Outlier detection tasks have been playing a critical role in AI safety. ...
research
03/17/2023

Detecting Out-of-distribution Examples via Class-conditional Impressions Reappearing

Out-of-distribution (OOD) detection aims at enhancing standard deep neur...
research
09/09/2023

HAct: Out-of-Distribution Detection with Neural Net Activation Histograms

We propose a simple, efficient, and accurate method for detecting out-of...

Please sign up or login with your details

Forgot password? Click here to reset