Extending Dynamic Bayesian Networks for Anomaly Detection in Complex Logs

05/18/2018
by   Stephen Pauwels, et al.
0

Checking various log files from different processes can be a tedious task as these logs contain lots of events, each with a (possibly large) number of attributes. We developed a way to automatically model log files and detect outlier traces in the data. For that we extend Dynamic Bayesian Networks to model the normal behavior found in log files. We introduce a new algorithm that is able to learn a model of a log file starting from the data itself. The model is capable of scoring traces even when new values or new combinations of values appear in the log file.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2023

ClusterLog: Clustering Logs for Effective Log-based Anomaly Detection

With the increasing prevalence of scalable file systems in the context o...
research
04/10/2023

Extension of Dictionary-Based Compression Algorithms for the Quantitative Visualization of Patterns from Log Files

Many services today massively and continuously produce log files of diff...
research
01/13/2021

Multi-Source Anomaly Detection in Distributed IT Systems

The multi-source data generated by distributed systems, provide a holist...
research
11/06/2017

SAIC: Identifying Configuration Files for System Configuration Management

Systems can become misconfigured for a variety of reasons such as operat...
research
08/28/2019

Immutable Log Storage as a Service

Logs contain critical information about the quality of the rendered serv...
research
08/01/2019

A compression based framework for the detection of anomalies in heterogeneous data sources

Nowadays, information and communications technology systems are fundamen...
research
01/16/2014

Intrusion Detection using Continuous Time Bayesian Networks

Intrusion detection systems (IDSs) fall into two high-level categories: ...

Please sign up or login with your details

Forgot password? Click here to reset