GLOD: Gaussian Likelihood Out of Distribution Detector

08/16/2020
by   Guy Amit, et al.
0

Discriminative deep neural networks (DNNs) do well at classifying input associated with the classes they have been trained on. However, out-of-distribution (OOD) input poses a great challenge to such models and consequently represents a major risk when these models are used in safety-critical systems. In the last two years, extensive research has been performed in the domain of OOD detection. This research has relied mainly on training the model with OOD data or using an auxiliary (external) model for OOD detection. Such methods have limited capability in detecting OOD samples and may not be applicable in many real world use cases. In this paper, we propose GLOD - Gaussian likelihood out of distribution detector - an extended DNN classifier capable of efficiently detecting OOD samples without relying on OOD training data or an external detection model. GLOD uses a layer that models the Gaussian density function of the trained classes. The layer outputs are used to estimate a Log-Likelihood Ratio which is employed to detect OOD samples. We evaluate GLOD's detection performance on three datasets: SVHN, CIFAR-10, and CIFAR-100. Our results show that GLOD surpasses state-of-the-art OOD detection techniques in detection performance by a large margin.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2022

Performance Analysis of Out-of-Distribution Detection on Trained Neural Networks

Several areas have been improved with Deep Learning during the past year...
research
10/25/2020

Multiscale Score Matching for Out-of-Distribution Detection

We present a new methodology for detecting out-of-distribution (OOD) ima...
research
04/11/2023

Unsupervised out-of-distribution detection for safer robotically-guided retinal microsurgery

Purpose: A fundamental problem in designing safe machine learning system...
research
12/15/2020

Exploring Vicinal Risk Minimization for Lightweight Out-of-Distribution Detection

Deep neural networks have found widespread adoption in solving complex t...
research
01/15/2020

Deep Residual Flow for Novelty Detection

The effective application of neural networks in the real-world relies on...
research
03/01/2022

Layer Adaptive Deep Neural Networks for Out-of-distribution Detection

During the forward pass of Deep Neural Networks (DNNs), inputs gradually...
research
10/18/2021

Single Layer Predictive Normalized Maximum Likelihood for Out-of-Distribution Detection

Detecting out-of-distribution (OOD) samples is vital for developing mach...

Please sign up or login with your details

Forgot password? Click here to reset