Unsupervised Energy-based Out-of-distribution Detection using Stiefel-Restricted Kernel Machine

02/16/2021
by   Francesco Tonin, et al.
0

Detecting out-of-distribution (OOD) samples is an essential requirement for the deployment of machine learning systems in the real world. Until now, research on energy-based OOD detectors has focused on the softmax confidence score from a pre-trained neural network classifier with access to class labels. In contrast, we propose an unsupervised energy-based OOD detector leveraging the Stiefel-Restricted Kernel Machine (St-RKM). Training requires minimizing an objective function with an autoencoder loss term and the RKM energy where the interconnection matrix lies on the Stiefel manifold. Further, we outline multiple energy function definitions based on the RKM framework and discuss their utility. In the experiments on standard datasets, the proposed method improves over the existing energy-based OOD detectors and deep generative models. Through several ablation studies, we further illustrate the merit of each proposed energy function on the OOD detection performance.

READ FULL TEXT
research
10/08/2020

Energy-based Out-of-distribution Detection

Determining whether inputs are out-of-distribution (OOD) is an essential...
research
08/23/2022

Semantic Driven Energy based Out-of-Distribution Detection

Detecting Out-of-Distribution (OOD) samples in real world visual applica...
research
02/27/2023

Reconstruction-based Out-of-Distribution Detection for Short-Range FMCW Radar

Out-of-distribution (OOD) detection recently has drawn attention due to ...
research
10/17/2022

Disentangling Confidence Score Distribution for Out-of-Domain Intent Detection with Energy-Based Learning

Detecting Out-of-Domain (OOD) or unknown intents from user queries is es...
research
07/10/2018

A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks

Detecting test samples drawn sufficiently far away from the training dis...
research
02/06/2020

Neural Network Representation Control: Gaussian Isolation Machines and CVC Regularization

In many cases, neural network classifiers are likely to be exposed to in...
research
12/20/2021

Energy-bounded Learning for Robust Models of Code

In programming, learning code representations has a variety of applicati...

Please sign up or login with your details

Forgot password? Click here to reset