Oversampling Log Messages Using a Sequence Generative Adversarial Network for Anomaly Detection and Classification

12/09/2019
by   Amir Farzad, et al.
1

Dealing with imbalanced data is one the main challenges in machine/deep learning algorithms for classification. This issue is more important with log message data as it is typically imbalanced and negative logs are rare. In this paper, a model is proposed to generate text log messages using a SeqGAN network. Then features are extracted using an Autoencoder and anomaly detection and classification is done using a GRU network. The proposed model is evaluated with two imbalanced log data sets, namely BGL and Openstack. Results are presented which show that oversampling and balancing data increases the accuracy of anomaly detection and classification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2019

Log Message Anomaly Detection and Classification Using Auto-B/LSTM and Auto-GRU

Log messages are now widely used in software systems. They are important...
research
08/19/2022

Feature Selection for Fault Detection and Prediction based on Event Log Analysis

Event logs are widely used for anomaly detection and prediction in compl...
research
01/25/2023

PULL: Reactive Log Anomaly Detection Based On Iterative PU Learning

Due to the complexity of modern IT services, failures can be manifold, o...
research
11/25/2022

Composite Score for Anomaly Detection in Imbalanced Real-World Industrial Dataset

In recent years, the industrial sector has evolved towards its fourth re...
research
09/06/2023

A Critical Review of Common Log Data Sets Used for Evaluation of Sequence-based Anomaly Detection Techniques

Log data store event execution patterns that correspond to underlying wo...
research
01/05/2022

Latent Vector Expansion using Autoencoder for Anomaly Detection

Deep learning methods can classify various unstructured data such as ima...
research
08/05/2021

Locally Interpretable One-Class Anomaly Detection for Credit Card Fraud Detection

For the highly imbalanced credit card fraud detection problem, most exis...

Please sign up or login with your details

Forgot password? Click here to reset