Unsupervised Detection and Explanation of Latent-class Contextual Anomalies

06/29/2018
by   Jacob Kauffmann, et al.
0

Detecting and explaining anomalies is a challenging effort. This holds especially true when data exhibits strong dependencies and single measurements need to be assessed and analyzed in their respective context. In this work, we consider scenarios where measurements are non-i.i.d, i.e. where samples are dependent on corresponding discrete latent variables which are connected through some given dependency structure, the contextual information. Our contribution is twofold: (i) Building atop of support vector data description (SVDD), we derive a method able to cope with latent-class dependency structure that can still be optimized efficiently. We further show that our approach neatly generalizes vanilla SVDD as well as k-means and conditional random fields (CRF) and provide a corresponding probabilistic interpretation. (ii) In unsupervised scenarios where it is not possible to quantify the accuracy of an anomaly detector, having an human-interpretable solution is the key to success. Based on deep Taylor decomposition and a reformulation of our trained anomaly detector as a neural network, we are able to backpropagate predictions to pixel-domain and thus identify features and regions of high relevance. We demonstrate the usefulness of our novel approach on toy data with known spatio-temporal structure and successfully validate on synthetic as well as real world off-shore data from the oil industry.

READ FULL TEXT
research
06/16/2021

X-MAN: Explaining multiple sources of anomalies in video

Our objective is to detect anomalies in video while also automatically e...
research
02/22/2023

Robust and Explainable Contextual Anomaly Detection using Quantile Regression Forests

Traditional anomaly detection methods aim to identify objects that devia...
research
04/16/2023

Time-series Anomaly Detection via Contextual Discriminative Contrastive Learning

Detecting anomalies in temporal data is challenging due to anomalies bei...
research
08/20/2017

Explaining Anomalies in Groups with Characterizing Subspace Rules

Anomaly detection has numerous applications and has been studied vastly....
research
01/27/2021

Wisdom of the Contexts: Active Ensemble Learning for Contextual Anomaly Detection

In contextual anomaly detection (CAD), an object is only considered anom...
research
04/06/2023

From Explanation to Action: An End-to-End Human-in-the-loop Framework for Anomaly Reasoning and Management

Anomalies are often indicators of malfunction or inefficiency in various...

Please sign up or login with your details

Forgot password? Click here to reset