Detecting and Ranking Causal Anomalies in End-to-End Complex System

01/18/2023
by   Ching Chang, et al.
0

With the rapid development of technology, the automated monitoring systems of large-scale factories are becoming more and more important. By collecting a large amount of machine sensor data, we can have many ways to find anomalies. We believe that the real core value of an automated monitoring system is to identify and track the cause of the problem. The most famous method for finding causal anomalies is RCA, but there are many problems that cannot be ignored. They used the AutoRegressive eXogenous (ARX) model to create a time-invariant correlation network as a machine profile, and then use this profile to track the causal anomalies by means of a method called fault propagation. There are two major problems in describing the behavior of a machine by using the correlation network established by ARX: (1) It does not take into account the diversity of states (2) It does not separately consider the correlations with different time-lag. Based on these problems, we propose a framework called Ranking Causal Anomalies in End-to-End System (RCAE2E), which completely solves the problems mentioned above. In the experimental part, we use synthetic data and real-world large-scale photoelectric factory data to verify the correctness and existence of our method hypothesis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/04/2020

Root Cause Detection Among Anomalous Time Series Using Temporal State Alignment

The recent increase in the scale and complexity of software systems has ...
research
02/20/2023

Enhancing Causal Discovery from Robot Sensor Data in Dynamic Scenarios

Identifying the main features and learning the causal relationships of a...
research
03/07/2023

Root Cause Identification for Collective Anomalies in Time Series given an Acyclic Summary Causal Graph with Loops

This paper presents an approach for identifying the root causes of colle...
research
06/07/2020

A Novel Algorithm for Optimized Real Time Anomaly Detection in Timeseries

Observations in data which are significantly different from its neighbou...
research
02/20/2018

007: Democratically Finding The Cause of Packet Drops

Network failures continue to plague datacenter operators as their sympto...
research
07/28/2021

Bayesian Autoencoders for Drift Detection in Industrial Environments

Autoencoders are unsupervised models which have been used for detecting ...
research
07/18/2022

Lightweight Automated Feature Monitoring for Data Streams

Monitoring the behavior of automated real-time stream processing systems...

Please sign up or login with your details

Forgot password? Click here to reset