Detecting Out-of-distribution Examples via Class-conditional Impressions Reappearing

03/17/2023
by   Jinggang Chen, et al.
0

Out-of-distribution (OOD) detection aims at enhancing standard deep neural networks to distinguish anomalous inputs from original training data. Previous progress has introduced various approaches where the in-distribution training data and even several OOD examples are prerequisites. However, due to privacy and security, auxiliary data tends to be impractical in a real-world scenario. In this paper, we propose a data-free method without training on natural data, called Class-Conditional Impressions Reappearing (C2IR), which utilizes image impressions from the fixed model to recover class-conditional feature statistics. Based on that, we introduce Integral Probability Metrics to estimate layer-wise class-conditional deviations and obtain layer weights by Measuring Gradient-based Importance (MGI). The experiments verify the effectiveness of our method and indicate that C2IR outperforms other post-hoc methods and reaches comparable performance to the full access (ID and OOD) detection method, especially in the far-OOD dataset (SVHN).

READ FULL TEXT
research
07/29/2020

Detecting Anomalous Inputs to DNN Classifiers By Joint Statistical Testing at the Layers

Detecting anomalous inputs, such as adversarial and out-of-distribution ...
research
10/23/2019

Detecting Out-of-Distribution Inputs in Deep Neural Networks Using an Early-Layer Output

Deep neural networks achieve superior performance in challenging tasks s...
research
04/10/2022

Effective Out-of-Distribution Detection in Classifier Based on PEDCC-Loss

Deep neural networks suffer from the overconfidence issue in the open wo...
research
04/30/2022

ClusterQ: Semantic Feature Distribution Alignment for Data-Free Quantization

Network quantization has emerged as a promising method for model compres...
research
11/02/2021

Out of distribution detection for skin and malaria images

Deep neural networks have shown promising results in disease detection a...
research
09/21/2022

Variational Inference for Infinitely Deep Neural Networks

We introduce the unbounded depth neural network (UDN), an infinitely dee...
research
04/06/2023

Probing the Purview of Neural Networks via Gradient Analysis

We analyze the data-dependent capacity of neural networks and assess ano...

Please sign up or login with your details

Forgot password? Click here to reset