Feature space reduction as data preprocessing for the anomaly detection

03/13/2022
by   Simon Bilik, et al.
0

In this paper, we present two pipelines in order to reduce the feature space for anomaly detection using the One Class SVM. As a first stage of both pipelines, we compare the performance of three convolutional autoencoders. We use the PCA method together with t-SNE as the first pipeline and the reconstruction errors based method as the second. Both methods have potential for the anomaly detection, but the reconstruction error metrics prove to be more robust for this task. We show that the convolutional autoencoder architecture doesn't have a significant effect for this task and we prove the potential of our approach on the real world dataset.

READ FULL TEXT

page 3

page 4

research
07/03/2022

Anomaly Detection with Adversarially Learned Perturbations of Latent Space

Anomaly detection is to identify samples that do not conform to the dist...
research
10/28/2020

Dimensionality Reduction and Anomaly Detection for CPPS Data using Autoencoder

Unsupervised anomaly detection (AD) is a major topic in the field of Cyb...
research
09/08/2019

Shapley Values of Reconstruction Errors of PCA for Explaining Anomaly Detection

We present a method to compute the Shapley values of reconstruction erro...
research
05/08/2022

Network Traffic Anomaly Detection Method Based on Multi scale Residual Feature

To address the problem that traditional network traffic anomaly detectio...
research
04/22/2020

Discovering Imperfectly Observable Adversarial Actions using Anomaly Detection

Anomaly detection is a method for discovering unusual and suspicious beh...
research
05/08/2020

A Showcase of the Use of Autoencoders in Feature Learning Applications

Autoencoders are techniques for data representation learning based on ar...
research
09/06/2020

Anomaly Detection With Partitioning Overfitting Autoencoder Ensembles

In this paper, we propose POTATOES (Partitioning OverfiTing AuTOencoder ...

Please sign up or login with your details

Forgot password? Click here to reset