Adaptable and Interpretable Framework for Novelty Detection in Real-Time IoT Systems

04/06/2023
by   Marek Wadinger, et al.
0

This paper presents the Real-time Adaptive and Interpretable Detection (RAID) algorithm. The novel approach addresses the limitations of state-of-the-art anomaly detection methods for multivariate dynamic processes, which are restricted to detecting anomalies within the scope of the model training conditions. The RAID algorithm adapts to non-stationary effects such as data drift and change points that may not be accounted for during model development, resulting in prolonged service life. A dynamic model based on joint probability distribution handles anomalous behavior detection in a system and the root cause isolation based on adaptive process limits. RAID algorithm does not require changes to existing process automation infrastructures, making it highly deployable across different domains. Two case studies involving real dynamic system data demonstrate the benefits of the RAID algorithm, including change point adaptation, root cause isolation, and improved detection accuracy.

READ FULL TEXT
research
01/31/2023

Real-Time Outlier Detection with Dynamic Process Limits

Anomaly detection methods are part of the systems where rare events may ...
research
06/09/2022

Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream

Online anomaly detection from a data stream is critical for the safety a...
research
06/07/2020

A Novel Algorithm for Optimized Real Time Anomaly Detection in Timeseries

Observations in data which are significantly different from its neighbou...
research
05/31/2018

Root-cause Analysis for Time-series Anomalies via Spatiotemporal Graphical Modeling in Distributed Complex Systems

Performance monitoring, anomaly detection, and root-cause analysis in co...
research
02/13/2023

Unsupervised Detection of Behavioural Drifts with Dynamic Clustering and Trajectory Analysis

Real-time monitoring of human behaviours, especially in e-Health applica...
research
08/02/2021

Efficacy of Statistical and Artificial Intelligence-based False Information Cyberattack Detection Models for Connected Vehicles

Connected vehicles (CVs), because of the external connectivity with othe...
research
06/18/2023

Concept-Based Visual Analysis of Dynamic Textual Data

Analyzing how interrelated ideas flow within and between multiple social...

Please sign up or login with your details

Forgot password? Click here to reset