Statistical Evaluation of Spectral Methods for Anomaly Detection in Networks

11/04/2017
by   Tomilayo Komolafe, et al.
0

Monitoring of networks for anomaly detection has attracted a lot of attention in recent years especially with the rise of connected devices and social networks. This is of importance as anomaly detection could span a wide range of application, from detecting terrorist cells in counter-terrorism efforts to phishing attacks in social network circles. For this reason, numerous techniques for anomaly detection have been introduced. However, application of these techniques to more complex network models is hindered by various challenges such as the size of the network being investigated, how much apriori information is needed, the size of the anomalous graph, among others. A recent technique introduced by Miller et al, which relies on a spectral framework for anomaly detection, has the potential to address many of these challenges. In their discussion of the spectral framework, three algorithms were proposed that relied on the eigenvalues and eigenvectors of the residual matrix of a binary network. The authors demonstrated the ability to detect anomalous subgraphs that were less than 1% of the network size. However, to date, there is little work that has been done to evaluate the statistical performance of these algorithms. This study investigates the statistical properties of the spectral methods, specifically the Chi-square and L_1 norm algorithm proposed by Miller. We will analyze the performance of the algorithm using simulated networks and also extend the method's application to count networks. Finally we will make some methodological improvements and recommendations to both algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2022

Deep Learning for Time Series Anomaly Detection: A Survey

Time series anomaly detection has applications in a wide range of resear...
research
10/15/2019

The Value of Summary Statistics for Anomaly Detection in Temporally-Evolving Networks: A Performance Evaluation Study

Network data has emerged as an active research area in statistics. Much ...
research
07/24/2018

Anomaly detection in static networks using egonets

Network data has rapidly emerged as an important and active area of stat...
research
12/11/2013

Near-optimal Anomaly Detection in Graphs using Lovasz Extended Scan Statistic

The detection of anomalous activity in graphs is a statistical problem t...
research
01/29/2014

A Spectral Framework for Anomalous Subgraph Detection

A wide variety of application domains are concerned with data consisting...
research
10/13/2011

Discovering Emerging Topics in Social Streams via Link Anomaly Detection

Detection of emerging topics are now receiving renewed interest motivate...
research
06/16/2021

Anomaly Detection and Automated Labeling for Voter Registration File Changes

Voter eligibility in United States elections is determined by a patchwor...

Please sign up or login with your details

Forgot password? Click here to reset