Improving Novelty Detection using the Reconstructions of Nearest Neighbours

11/11/2021
by   Michael Mesarcik, et al.
8

We show that using nearest neighbours in the latent space of autoencoders (AE) significantly improves performance of semi-supervised novelty detection in both single and multi-class contexts. Autoencoding methods detect novelty by learning to differentiate between the non-novel training class(es) and all other unseen classes. Our method harnesses a combination of the reconstructions of the nearest neighbours and the latent-neighbour distances of a given input's latent representation. We demonstrate that our nearest-latent-neighbours (NLN) algorithm is memory and time efficient, does not require significant data augmentation, nor is reliant on pre-trained networks. Furthermore, we show that the NLN-algorithm is easily applicable to multiple datasets without modification. Additionally, the proposed algorithm is agnostic to autoencoder architecture and reconstruction error method. We validate our method across several standard datasets for a variety of different autoencoding architectures such as vanilla, adversarial and variational autoencoders using either reconstruction, residual or feature consistent losses. The results show that the NLN algorithm grants up to a 17 Operating Characteristics (AUROC) curve performance for the multi-class case and 8

READ FULL TEXT

page 2

page 5

page 6

page 7

research
01/07/2021

OAAE: Adversarial Autoencoders for Novelty Detection in Multi-modal Normality Case via Orthogonalized Latent Space

Novelty detection using deep generative models such as autoencoder, gene...
research
12/06/2018

Improving Reconstruction Autoencoder Out-of-distribution Detection with Mahalanobis Distance

There is an increasingly apparent need for validating the classification...
research
08/25/2021

Adversarially Robust One-class Novelty Detection

One-class novelty detectors are trained with examples of a particular cl...
research
07/24/2020

Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations

Anomaly detection for Magnetic Resonance Images (MRIs) can be solved wit...
research
05/11/2019

Segregation Network for Multi-Class Novelty Detection

The problem of multiple class novelty detection is gaining increasing im...
research
03/04/2022

Rethinking Reconstruction Autoencoder-Based Out-of-Distribution Detection

In some scenarios, classifier requires detecting out-of-distribution sam...
research
07/16/2020

CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instances

Novelty detection, i.e., identifying whether a given sample is drawn fro...

Please sign up or login with your details

Forgot password? Click here to reset