Unsupervised Outlier Detection using Memory and Contrastive Learning

07/27/2021
by   Ning Huyan, et al.
12

Outlier detection is one of the most important processes taken to create good, reliable data in machine learning. The most methods of outlier detection leverage an auxiliary reconstruction task by assuming that outliers are more difficult to be recovered than normal samples (inliers). However, it is not always true, especially for auto-encoder (AE) based models. They may recover certain outliers even outliers are not in the training data, because they do not constrain the feature learning. Instead, we think outlier detection can be done in the feature space by measuring the feature distance between outliers and inliers. We then propose a framework, MCOD, using a memory module and a contrastive learning module. The memory module constrains the consistency of features, which represent the normal data. The contrastive learning module learns more discriminating features, which boosts the distinction between outliers and inliers. Extensive experiments on four benchmark datasets show that our proposed MCOD achieves a considerable performance and outperforms nine state-of-the-art methods.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 9

page 11

page 12

page 13

research
06/16/2021

Comparison of Outlier Detection Techniques for Structured Data

An outlier is an observation or a data point that is far from rest of th...
research
11/28/2017

Contextual Outlier Interpretation

Outlier detection plays an essential role in many data-driven applicatio...
research
07/16/2020

In search of the weirdest galaxies in the Universe

Weird galaxies are outliers that have either unknown or very uncommon fe...
research
10/26/2018

Outlier Detection using Generative Models with Theoretical Performance Guarantees

This paper considers the problem of recovering signals from compressed m...
research
02/04/2021

RECol: Reconstruction Error Columns for Outlier Detection

Detecting outliers or anomalies is a common data analysis task. As a sub...
research
05/19/2022

Identifying outliers in astronomical images with unsupervised machine learning

Astronomical outliers, such as unusual, rare or unknown types of astrono...
research
07/10/2020

Contrastive Training for Improved Out-of-Distribution Detection

Reliable detection of out-of-distribution (OOD) inputs is increasingly u...

Please sign up or login with your details

Forgot password? Click here to reset