DeepAI
Log In Sign Up

Isconna: Streaming Anomaly Detection with Frequency and Patterns

04/04/2021
by   Rui Liu, et al.
0

An edge stream is a common form of presentation of dynamic networks. It can evolve with time, with new types of nodes or edges being continuously added. Existing methods for anomaly detection rely on edge occurrence counts or compare pattern snippets found in historical records. In this work, we propose Isconna, which focuses on both the frequency and the pattern of edge records. The burst detection component targets anomalies between individual timestamps, while the pattern detection component highlights anomalies across segments of timestamps. These two components together produce three intermediate scores, which are aggregated into the final anomaly score. Isconna does not actively explore or maintain pattern snippets; it instead measures the consecutive presence and absence of edge records. Isconna is an online algorithm, it does not keep the original information of edge records; only statistical values are maintained in a few count-min sketches (CMS). Isconna's space complexity O(rc) is determined by two user-specific parameters, the size of CMSs. In worst case, Isconna's time complexity can be up to O(rc), but it can be amortized in practice. Experiments show that Isconna outperforms five state-of-the-art frequency- and/or pattern-based baselines on six real-world datasets with up to 20 million edge records.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/08/2021

Sketch-Based Streaming Anomaly Detection in Dynamic Graphs

Given a stream of graph edges from a dynamic graph, how can we assign an...
09/15/2020

Deep Reinforcement Learning for Unknown Anomaly Detection

We address a critical yet largely unsolved anomaly detection problem, in...
11/09/2020

F-FADE: Frequency Factorization for Anomaly Detection in Edge Streams

Edge streams are commonly used to capture interactions in dynamic networ...
09/17/2020

Real-Time Streaming Anomaly Detection in Dynamic Graphs

Given a stream of graph edges from a dynamic graph, how can we assign an...
10/24/2019

Fraud Detection in Networks: State-of-the-art

Financial fraud detection represents the challenge of finding anomalies ...
11/13/2019

Anomaly Detection in Large Scale Networks with Latent Space Models

We develop a real-time anomaly detection algorithm for directed activity...
09/02/2020

Reconstructing the Dynamic Sea Surface from Tide Gauge Records Using Optimal Data-Dependent Triangulations

Reconstructions of sea level prior to the satellite altimeter era are us...

Code Repositories

Isconna

Isconna: Streaming Anomaly Detection with Frequency and Patterns


view repo