HAct: Out-of-Distribution Detection with Neural Net Activation Histograms

09/09/2023

∙

by   Sudeepta Mondal, et al.

∙

0

∙

share

We propose a simple, efficient, and accurate method for detecting out-of-distribution (OOD) data for trained neural networks, a potential first step in methods for OOD generalization. We propose a novel descriptor, HAct - activation histograms, for OOD detection, that is, probability distributions (approximated by histograms) of output values of neural network layers under the influence of incoming data. We demonstrate that HAct is significantly more accurate than state-of-the-art on multiple OOD image classification benchmarks. For instance, our approach achieves a true positive rate (TPR) of 95 0.05 previous state-of-the-art by 20.66 of 95 HAct suitable for online implementation in monitoring deployed neural networks in practice at scale.