An efficient method for Out-of-Distribution Detection

02/23/2023
by   Mingyu Xu, et al.
0

Detecting out-of-distribution (OOD) data is critical to building reliable machine learning systems in the open world. The previous methods either need to use additional data or use the information of training data. The method of using only the parameter information of the model is relatively poor. We propose an efficient method for OOD detection using only model parameter information. To verify the effectiveness of our method, we conduct experiments on four benchmark datasets. Experimental results demonstrate that our RG outperforms existing state-of-the-art approaches by 4.57% in average AUROC. Meanwhile, our method is easy to implement and does not require additional OOD data or fine-tuning process. We can realize OOD detection in only one forward pass of any pretrained model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/13/2021

Thinkback: Task-SpecificOut-of-Distribution Detection

The increased success of Deep Learning (DL) has recently sparked large-s...
research
05/25/2022

Know Where You're Going: Meta-Learning for Parameter-Efficient Fine-tuning

A recent family of techniques, dubbed as lightweight fine-tuning methods...
research
04/24/2023

Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimization

Backdoor defense, which aims to detect or mitigate the effect of malicio...
research
07/10/2020

Contrastive Training for Improved Out-of-Distribution Detection

Reliable detection of out-of-distribution (OOD) inputs is increasingly u...
research
03/15/2022

Igeood: An Information Geometry Approach to Out-of-Distribution Detection

Reliable out-of-distribution (OOD) detection is fundamental to implement...
research
05/25/2019

Hyperparameter-Free Out-of-Distribution Detection Using Softmax of Scaled Cosine Similarity

The ability of detecting out-of-distribution (OOD) samples is important ...
research
12/28/2019

Detecting Out-of-Distribution Examples with In-distribution Examples and Gram Matrices

When presented with Out-of-Distribution (OOD) examples, deep neural netw...

Please sign up or login with your details

Forgot password? Click here to reset