DeepAI
Log In Sign Up

Isolation Distributional Kernel: A New Tool for Point Group Anomaly Detection

09/24/2020
by   Kai Ming Ting, et al.
4

We introduce Isolation Distributional Kernel as a new way to measure the similarity between two distributions. Existing approaches based on kernel mean embedding, which convert a point kernel to a distributional kernel, have two key issues: the point kernel employed has a feature map with intractable dimensionality; and it is data independent. This paper shows that Isolation Distributional Kernel (IDK), which is based on a data dependent point kernel, addresses both key issues. We demonstrate IDK's efficacy and efficiency as a new tool for kernel based anomaly detection for both point and group anomalies. Without explicit learning, using IDK alone outperforms existing kernel based point anomaly detector OCSVM and other kernel mean embedding methods that rely on Gaussian kernel. For group anomaly detection,we introduce an IDK based detector called IDK^2. It reformulates the problem of group anomaly detection in input space into the problem of point anomaly detection in Hilbert space, without the need for learning. IDK^2 runs orders of magnitude faster than group anomaly detector OCSMM.We reveal for the first time that an effective kernel based anomaly detector based on kernel mean embedding must employ a characteristic kernel which is data dependent.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/06/2021

New Methods and Datasets for Group Anomaly Detection From Fundamental Physics

The identification of anomalous overdensities in data - group or collect...
06/24/2019

Improving Stochastic Neighbour Embedding fundamentally with a well-defined data-dependent kernel

We identify a fundamental issue in the popular Stochastic Neighbour Embe...
12/07/2020

Efficient Nonlinear RX Anomaly Detectors

Current anomaly detection algorithms are typically challenged by either ...
04/05/2020

Anomaly Detection and Prototype Selection Using Polyhedron Curvature

We propose a novel approach to anomaly detection called Curvature Anomal...
08/09/2014

One-Class Support Measure Machines for Group Anomaly Detection

We propose one-class support measure machines (OCSMMs) for group anomaly...
01/24/2018

A Theoretical Investigation of Graph Degree as an Unsupervised Normality Measure

For a graph representation of a dataset, a straightforward normality mea...
01/30/2022

Approximate Bayesian Computation Based on Maxima Weighted Isolation Kernel Mapping

Motivation: The branching processes model yields unevenly stochastically...