TabADM: Unsupervised Tabular Anomaly Detection with Diffusion Models

07/23/2023
by   Guy Zamberg, et al.
0

Tables are an abundant form of data with use cases across all scientific fields. Real-world datasets often contain anomalous samples that can negatively affect downstream analysis. In this work, we only assume access to contaminated data and present a diffusion-based probabilistic model effective for unsupervised anomaly detection. Our model is trained to learn the density of normal samples by utilizing a unique rejection scheme to attenuate the influence of anomalies on the density estimation. At inference, we identify anomalies as samples in low-density regions. We use real data to demonstrate that our method improves detection capabilities over baselines. Furthermore, our method is relatively stable to the dimension of the data and does not require extensive hyperparameter tuning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2023

Anomaly Detection with Variance Stabilized Density Estimation

Density estimation based anomaly detection schemes typically model anoma...
research
10/09/2020

Algorithmic Frameworks for the Detection of High Density Anomalies

This study explores the concept of high-density anomalies. As opposed to...
research
03/22/2021

Mining Scientific Workflows for Anomalous Data Transfers

Modern scientific workflows are data-driven and are often executed on di...
research
01/14/2020

Unsupervised Distribution Learning for Lunar Surface Anomaly Detection

In this work we show that modern data-driven machine learning techniques...
research
05/01/2023

Unsupervised anomaly detection algorithms on real-world data: how many do we need?

In this study we evaluate 32 unsupervised anomaly detection algorithms o...
research
10/31/2018

Consistency-based anomaly detection with adaptive multiple-hypotheses predictions

In out-of-distribution classification tasks, only some classes - the nor...
research
07/16/2023

LafitE: Latent Diffusion Model with Feature Editing for Unsupervised Multi-class Anomaly Detection

In the context of flexible manufacturing systems that are required to pr...

Please sign up or login with your details

Forgot password? Click here to reset