Correlation-aware Deep Generative Model for Unsupervised Anomaly Detection

02/18/2020
by   Haoyi Fan, et al.
0

Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturing normal patterns from which the abnormal ones deviate. In this paper, we propose a method of Correlation aware unsupervised Anomaly detection via Deep Gaussian Mixture Model (CADGMM), which captures the complex correlation among data points for high-quality low-dimensional representation learning. Specifically, the relations among data samples are correlated firstly in forms of a graph structure, in which, the node denotes the sample and the edge denotes the correlation between two samples from the feature space. Then, a dual-encoder that consists of a graph encoder and a feature encoder, is employed to encode both the feature and correlation information of samples into the low-dimensional latent space jointly, followed by a decoder for data reconstruction. Finally, a separate estimation network as a Gaussian Mixture Model is utilized to estimate the density of the learned latent vector, and the anomalies can be detected by measuring the energy of the samples. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2020

AnomalyDAE: Dual autoencoder for anomaly detection on attributed networks

Anomaly detection on attributed networks aims at finding nodes whose pat...
research
05/30/2021

CSCAD: Correlation Structure-based Collective Anomaly Detection in Complex System

Detecting anomalies in large complex systems is a critical and challengi...
research
05/29/2018

Video Anomaly Detection and Localization via Gaussian Mixture Fully Convolutional Variational Autoencoder

We present a novel end-to-end partially supervised deep learning approac...
research
09/01/2021

Deep Dual Support Vector Data Description for Anomaly Detection on Attributed Networks

Networks are ubiquitous in the real world such as social networks and co...
research
01/01/2023

Deep Correlation-Aware Kernelized Autoencoders for Anomaly Detection in Cybersecurity

Unsupervised learning-based anomaly detection in latent space has gained...
research
06/15/2023

Unsupervised Anomaly Detection via Nonlinear Manifold Learning

Anomalies are samples that significantly deviate from the rest of the da...
research
02/04/2020

Acoustic anomaly detection via latent regularized gaussian mixture generative adversarial networks

Acoustic anomaly detection aims at distinguishing abnormal acoustic sign...

Please sign up or login with your details

Forgot password? Click here to reset