Testing for Typicality with Respect to an Ensemble of Learned Distributions

11/11/2020
by   Forrest Laine, et al.
0

Methods of performing anomaly detection on high-dimensional data sets are needed, since algorithms which are trained on data are only expected to perform well on data that is similar to the training data. There are theoretical results on the ability to detect if a population of data is likely to come from a known base distribution, which is known as the goodness-of-fit problem. One-sample approaches to this problem offer significant computational advantages for online testing, but require knowing a model of the base distribution. The ability to correctly reject anomalous data in this setting hinges on the accuracy of the model of the base distribution. For high dimensional data, learning an accurate-enough model of the base distribution such that anomaly detection works reliably is very challenging, as many researchers have noted in recent years. Existing methods for the one-sample goodness-of-fit problem do not account for the fact that a model of the base distribution is learned. To address that gap, we offer a theoretically motivated approach to account for the density learning procedure. In particular, we propose training an ensemble of density models, considering data to be anomalous if the data is anomalous with respect to any member of the ensemble. We provide a theoretical justification for this approach, proving first that a test on typicality is a valid approach to the goodness-of-fit problem, and then proving that for a correctly constructed ensemble of models, the intersection of typical sets of the models lies in the interior of the typical set of the base distribution. We present our method in the context of an example on synthetic data in which the effects we consider can easily be seen.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 16

12/06/2018

Adversarially Learned Anomaly Detection

Anomaly detection is a significant and hence well-studied problem. Howev...
12/04/2019

Copula-based anomaly scoring and localization for large-scale, high-dimensional continuous data

The anomaly detection method presented by this paper has a special featu...
01/25/2019

Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection

Despite inherent ill-definition, anomaly detection is a research endeavo...
08/12/2019

Anomaly Detection in High Dimensional Data

The HDoutliers algorithm is a powerful unsupervised algorithm for detect...
02/14/2012

Nonparametric Divergence Estimation with Applications to Machine Learning on Distributions

Low-dimensional embedding, manifold learning, clustering, classification...
02/13/2020

Cutting out the Middle-Man: Training and Evaluating Energy-Based Models without Sampling

We present a new method for evaluating and training unnormalized density...
10/25/2020

On synthetic data generation for anomaly detection in complex social networks

This paper studies the feasibility of synthetic data generation for miss...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.