DeepAI AI Chat
Log In Sign Up

Anomaly Detection with Density Estimation

01/14/2020
by   Benjamin Nachman, et al.
Rutgers University
Berkeley Lab
94

We leverage recent breakthroughs in neural density estimation to propose a new unsupervised anomaly detection technique (ANODE). By estimating the probability density of the data in a signal region and in sidebands, and interpolating the latter into the signal region, a likelihood ratio of data vs. background can be constructed. This likelihood ratio is broadly sensitive to overdensities in the data that could be due to localized anomalies. In addition, a unique potential benefit of the ANODE method is that the background can be directly estimated using the learned densities. Finally, ANODE is robust against systematic differences between signal region and sidebands, giving it broader applicability than other methods. We demonstrate the power of this new approach using the LHC Olympics 2020 R&D Dataset. We show how ANODE can enhance the significance of a dijet bump hunt by up to a factor of 7 with a 10% accuracy on the background prediction. While the LHC is used as the recurring example, the methods developed here have a much broader applicability to anomaly detection in physics and beyond.

READ FULL TEXT

page 14

page 16

06/06/2023

High-dimensional and Permutation Invariant Anomaly Detection

Methods for anomaly detection of new physics processes are often limited...
12/21/2020

Unsupervised in-distribution anomaly detection of new physics through conditional density estimation

Anomaly detection is a key application of machine learning, but is gener...
09/20/2022

Collaborative Anomaly Detection

In recommendation systems, items are likely to be exposed to various use...
07/25/2023

Implicitly Normalized Explicitly Regularized Density Estimation

We propose a new approach to non-parametric density estimation, that is ...
01/18/2022

Invariant Representation Driven Neural Classifier for Anti-QCD Jet Tagging

We leverage representation learning and the inductive bias in neural-net...
04/13/2020

Anomaly Detection in Trajectory Data with Normalizing Flows

The task of detecting anomalous data patterns is as important in practic...
01/14/2020

Simulation Assisted Likelihood-free Anomaly Detection

Given the lack of evidence for new particle discoveries at the Large Had...

Code Repositories

ANODE

code for ANOmaly Detection with Density Estimation (https://arxiv.org/abs/2001.04990)


view repo