Anomaly Detection with Variance Stabilized Density Estimation

06/01/2023
by   Amit Rozner, et al.
0

Density estimation based anomaly detection schemes typically model anomalies as examples that reside in low-density regions. We propose a modified density estimation problem and demonstrate its effectiveness for anomaly detection. Specifically, we assume the density function of normal samples is uniform in some compact domain. This assumption implies the density function is more stable (with lower variance) around normal samples than anomalies. We first corroborate this assumption empirically using a wide range of real-world data. Then, we design a variance stabilized density estimation problem for maximizing the likelihood of the observed samples while minimizing the variance of the density around normal samples. We introduce an ensemble of autoregressive models to learn the variance stabilized distribution. Finally, we perform an extensive benchmark with 52 datasets demonstrating that our method leads to state-of-the-art results while alleviating the need for data-specific hyperparameter tuning.

READ FULL TEXT

page 3

page 5

page 8

research
07/23/2023

TabADM: Unsupervised Tabular Anomaly Detection with Diffusion Models

Tables are an abundant form of data with use cases across all scientific...
research
09/28/2016

A Discriminative Framework for Anomaly Detection in Large Videos

We address an anomaly detection setting in which training sequences are ...
research
07/04/2018

AND: Autoregressive Novelty Detectors

We propose an unsupervised model for novelty detection. The subject is t...
research
07/19/2019

Batch Uniformization for Minimizing Maximum Anomaly Score of DNN-based Anomaly Detection in Sounds

Use of an autoencoder (AE) as a normal model is a state-of-the-art techn...
research
12/14/2018

AdaFlow: Domain-Adaptive Density Estimator with Application to Anomaly Detection and Unpaired Cross-Domain Translation

We tackle unsupervised anomaly detection (UAD), a problem of detecting d...
research
05/11/2021

BikNN: Anomaly Estimation in Bilateral Domains with k-Nearest Neighbors

In this paper, a novel framework for anomaly estimation is proposed. The...
research
10/26/2022

AD-DMKDE: Anomaly Detection through Density Matrices and Fourier Features

This paper presents a novel density estimation method for anomaly detect...

Please sign up or login with your details

Forgot password? Click here to reset