CSCLog: A Component Subsequence Correlation-Aware Log Anomaly Detection Method

07/07/2023
by   Ling Chen, et al.
0

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in log sequences, which ignore the interactions of subsequences. To this end, we propose CSCLog, a Component Subsequence Correlation-Aware Log anomaly detection method, which not only captures the sequential dependencies in subsequences, but also models the implicit correlations of subsequences. Specifically, subsequences are extracted from log sequences based on components and the sequential dependencies in subsequences are captured by Long Short-Term Memory Networks (LSTMs). An implicit correlation encoder is introduced to model the implicit correlations of subsequences adaptively. In addition, Graph Convolution Networks (GCNs) are employed to accomplish the information interactions of subsequences. Finally, attention mechanisms are exploited to fuse the embeddings of all subsequences. Extensive experiments on four publicly available log datasets demonstrate the effectiveness of CSCLog, outperforming the best baseline by an average of 7.41

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2022

LogGD:Detecting Anomalies from System Logs by Graph Neural Networks

Log analysis is one of the main techniques engineers use to troubleshoot...
research
09/12/2023

GLAD: Content-aware Dynamic Graphs For Log Anomaly Detection

Logs play a crucial role in system monitoring and debugging by recording...
research
09/06/2023

A Critical Review of Common Log Data Sets Used for Evaluation of Sequence-based Anomaly Detection Techniques

Log data store event execution patterns that correspond to underlying wo...
research
07/17/2023

Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection

Multivariate time-series anomaly detection is critically important in ma...
research
09/06/2023

Reasonable Anomaly Detection in Long Sequences

Video anomaly detection is a challenging task due to the lack in approac...
research
10/05/2021

LogDP: Combining Dependency and Proximity for Log-based Anomaly Detection

Log analysis is an important technique that engineers use for troublesho...
research
02/13/2018

Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding

As spacecraft send back increasing amounts of telemetry data, improved a...

Please sign up or login with your details

Forgot password? Click here to reset