LogDP: Combining Dependency and Proximity for Log-based Anomaly Detection

10/05/2021
by   Yongzheng Xie, et al.
0

Log analysis is an important technique that engineers use for troubleshooting faults of large-scale service-oriented systems. In this study, we propose a novel semi-supervised log-based anomaly detection approach, LogDP, which utilizes the dependency relationships among log events and proximity among log sequences to detect the anomalies in massive unlabeled log data. LogDP divides log events into dependent and independent events, then learns normal patterns of dependent events using dependency and independent events using proximity. Events violating any normal pattern are identified as anomalies. By combining dependency and proximity, LogDP is able to achieve high detection accuracy. Extensive experiments have been conducted on real-world datasets, and the results show that LogDP outperforms six state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/07/2021

LogBERT: Log Anomaly Detection via BERT

Detecting anomalous events in online computer systems is crucial to prot...
research
11/13/2020

Dependency-based Anomaly Detection: Framework, Methods and Benchmark

Anomaly detection is an important research problem because anomalies oft...
research
08/24/2023

Try with Simpler – An Evaluation of Improved Principal Component Analysis in Log-based Anomaly Detection

The rapid growth of deep learning (DL) has spurred interest in enhancing...
research
09/12/2023

GLAD: Content-aware Dynamic Graphs For Log Anomaly Detection

Logs play a crucial role in system monitoring and debugging by recording...
research
03/15/2020

Self-trained Deep Ordinal Regression for End-to-End Video Anomaly Detection

Video anomaly detection is of critical practical importance to a variety...
research
08/04/2021

Sensing Anomalies like Humans: A Hominine Framework to Detect Abnormal Events from Unlabeled Videos

Video anomaly detection (VAD) has constantly been a vital topic in video...
research
07/07/2023

CSCLog: A Component Subsequence Correlation-Aware Log Anomaly Detection Method

Anomaly detection based on system logs plays an important role in intell...

Please sign up or login with your details

Forgot password? Click here to reset