Null Hypothesis Test for Anomaly Detection

10/05/2022
by   Jernej F. Kamenik, et al.
0

We extend the use of Classification Without Labels for anomaly detection with a hypothesis test designed to exclude the background-only hypothesis. By testing for statistical independence of the two discriminating dataset regions, we are able exclude the background-only hypothesis without relying on fixed anomaly score cuts or extrapolations of background estimates between regions. The method relies on the assumption of conditional independence of anomaly score features and dataset regions, which can be ensured using existing decorrelation techniques. As a benchmark example, we consider the LHC Olympics dataset where we show that mutual information represents a suitable test for statistical independence and our method exhibits excellent and robust performance at different signal fractions even in presence of realistic feature correlations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/19/2013

Network Anomaly Detection: A Survey and Comparative Analysis of Stochastic and Deterministic Methods

We present five methods to the problem of network anomaly detection. The...
research
10/13/2021

Challenges for Unsupervised Anomaly Detection in Particle Physics

Anomaly detection relies on designing a score to determine whether a par...
research
01/23/2020

Universal Data Anomaly Detection via Inverse Generative Adversary Network

The problem of detecting data anomaly is considered. Under the null hypo...
research
12/02/2021

Fast automatic deforestation detectors and their extensions for other spatial objects

This paper is devoted to the problem of detection of forest and non-fore...
research
08/03/2018

Robust Spectral Filtering and Anomaly Detection

We consider a setting, where the output of a linear dynamical system (LD...
research
02/27/2017

Statistical Anomaly Detection via Composite Hypothesis Testing for Markov Models

Under Markovian assumptions, we leverage a Central Limit Theorem (CLT) f...
research
12/19/2020

Bayesian unsupervised learning reveals hidden structure in concentrated electrolytes

Electrolytes play an important role in a plethora of applications rangin...

Please sign up or login with your details

Forgot password? Click here to reset