XGBOD: Improving Supervised Outlier Detection with Unsupervised Representation Learning

12/01/2019
by   Yue Zhao, et al.
0

A new semi-supervised ensemble algorithm called XGBOD (Extreme Gradient Boosting Outlier Detection) is proposed, described and demonstrated for the enhanced detection of outliers from normal observations in various practical datasets. The proposed framework combines the strengths of both supervised and unsupervised machine learning methods by creating a hybrid approach that exploits each of their individual performance capabilities in outlier detection. XGBOD uses multiple unsupervised outlier mining algorithms to extract useful representations from the underlying data that augment the predictive capabilities of an embedded supervised classifier on an improved feature space. The novel approach is shown to provide superior performance in comparison to competing individual detectors, the full ensemble and two existing representation learning based algorithms across seven outlier datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2022

SSDBCODI: Semi-Supervised Density-Based Clustering with Outliers Detection Integrated

Clustering analysis is one of the critical tasks in machine learning. Tr...
research
05/19/2021

Do We Really Need to Learn Representations from In-domain Data for Outlier Detection?

Unsupervised outlier detection, which predicts if a test sample is an ou...
research
06/13/2018

Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detection

Learning expressive low-dimensional representations of ultrahigh-dimensi...
research
04/08/2021

Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditions

We develop and rigorously evaluate a deep learning based system that can...
research
11/01/2022

Meta-Learning for Unsupervised Outlier Detection with Optimal Transport

Automated machine learning has been widely researched and adopted in the...
research
06/09/2021

Deep Clustering based Fair Outlier Detection

In this paper, we focus on the fairness issues regarding unsupervised ou...
research
03/17/2021

Fairness-aware Outlier Ensemble

Outlier ensemble methods have shown outstanding performance on the disco...

Please sign up or login with your details

Forgot password? Click here to reset