IPOF: An Extremely and Excitingly Simple Outlier Detection Booster via Infinite Propagation

08/01/2021
by   Sibo Zhu, et al.
9

Outlier detection is one of the most popular and continuously rising topics in the data mining field due to its crucial academic value and extensive industrial applications. Among different settings, unsupervised outlier detection is the most challenging and practical one, which attracts tremendous efforts from diverse perspectives. In this paper, we consider the score-based outlier detection category and point out that the performance of current outlier detection algorithms might be further boosted by score propagation. Specifically, we propose Infinite Propagation of Outlier Factor (iPOF) algorithm, an extremely and excitingly simple outlier detection booster via infinite propagation. By employing score-based outlier detectors for initialization, iPOF updates each data point's outlier score by averaging the outlier factors of its nearest common neighbors. Extensive experimental results on numerous datasets in various domains demonstrate the effectiveness and efficiency of iPOF significantly over several classical and recent state-of-the-art methods. We also provide the parameter analysis on the number of neighbors, the unique parameter in iPOF, and different initial outlier detectors for general validation. It is worthy to note that iPOF brings in positive improvements ranging from 2 cases, iPOF boosts the performance over 3000 detection algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/17/2023

Neighborhood Averaging for Improving Outlier Detectors

We hypothesize that similar objects should have similar outlier scores. ...
research
06/28/2016

A Local Density-Based Approach for Local Outlier Detection

This paper presents a simple but effective density-based outlier detecti...
research
05/27/2020

An Entropy Based Outlier Score and its Application to Novelty Detection for Road Infrastructure Images

A novel unsupervised outlier score, which can be embedded into graph bas...
research
11/23/2019

DCSO: Dynamic Combination of Detector Scores for Outlier Ensembles

Selecting and combining the outlier scores of different base detectors u...
research
07/23/2023

RANSAC-NN: Unsupervised Image Outlier Detection using RANSAC

Image outlier detection (OD) is crucial for ensuring the quality and acc...
research
03/12/2020

PyODDS: An End-to-end Outlier Detection System with Automated Machine Learning

Outlier detection is an important task for various data mining applicati...
research
11/25/2014

Similarity- based approach for outlier detection

This paper presents a new approach for detecting outliers by introducing...

Please sign up or login with your details

Forgot password? Click here to reset