BikNN: Anomaly Estimation in Bilateral Domains with k-Nearest Neighbors

05/11/2021
by   Zhongping Ji, et al.
0

In this paper, a novel framework for anomaly estimation is proposed. The basic idea behind our method is to reduce the data into a two-dimensional space and then rank each data point in the reduced space. We attempt to estimate the degree of anomaly in both spatial and density domains. Specifically, we transform the data points into a density space and measure the distances in density domain between each point and its k-Nearest Neighbors in spatial domain. Then, an anomaly coordinate system is built by collecting two unilateral anomalies from k-nearest neighbors of each point. Further more, we introduce two schemes to model their correlation and combine them to get the final anomaly score. Experiments performed on the synthetic and real world datasets demonstrate that the proposed method performs well and achieve highest average performance. We also show that the proposed method can provide visualization and classification of the anomalies in a simple manner. Due to the complexity of the anomaly, none of the existing methods can perform best on all benchmark datasets. Our method takes into account both the spatial domain and the density domain and can be adapted to different datasets by adjusting a few parameters manually.

READ FULL TEXT

page 5

page 8

research
05/28/2023

k-NNN: Nearest Neighbors of Neighbors for Anomaly Detection

Anomaly detection aims at identifying images that deviate significantly ...
research
06/01/2023

Anomaly Detection with Variance Stabilized Density Estimation

Density estimation based anomaly detection schemes typically model anoma...
research
11/12/2022

Far Away in the Deep Space: Nearest-Neighbor-Based Dense Out-of-Distribution Detection

The key to out-of-distribution detection is density estimation of the in...
research
05/02/2014

A Rank-SVM Approach to Anomaly Detection

We propose a novel non-parametric adaptive anomaly detection algorithm f...
research
09/06/2021

gen2Out: Detecting and Ranking Generalized Anomalies

In a cloud of m-dimensional data points, how would we spot, as well as r...
research
06/01/2018

k-nearest neighbors prediction and classification for spatial data

We propose a nonparametric predictor and a supervised classification bas...
research
09/13/2017

Visualization of Big Spatial Data using Coresets for Kernel Density Estimates

The size of large, geo-located datasets has reached scales where visuali...

Please sign up or login with your details

Forgot password? Click here to reset