Average Localised Proximity: a new data descriptor with good default one-class classification performance

01/26/2021
by   Oliver Urs Lenz, et al.
0

One-class classification is a challenging subfield of machine learning in which so-called data descriptors are used to predict membership of a class based solely on positive examples of that class, and no counter-examples. A number of data descriptors that have been shown to perform well in previous studies of one-class classification, like the Support Vector Machine (SVM), require setting one or more hyperparameters. There has been no systematic attempt to date to determine optimal default values for these hyperparameters, which limits their ease of use, especially in comparison with hyperparameter-free proposals like the Isolation Forest (IF). We address this issue by determining optimal default hyperparameter values across a collection of 246 one-class classification problems derived from 50 different real-world datasets. In addition, we propose a new data descriptor, Average Localised Proximity (ALP) to address certain issues with existing approaches based on nearest neighbour distances. Finally, we evaluate classification performance using a leave-one-dataset-out procedure, and find strong evidence that ALP outperforms IF and a number of other data descriptors, as well as weak evidence that it outperforms SVM, making ALP a good default choice.

READ FULL TEXT

page 18

page 21

research
02/04/2021

Optimised one-class classification performance

We provide a thorough treatment of hyperparameter optimisation for three...
research
03/20/2017

On the Use of Default Parameter Settings in the Empirical Evaluation of Classification Algorithms

We demonstrate that, for a range of state-of-the-art machine learning al...
research
06/04/2019

A meta-learning recommender system for hyperparameter tuning: predicting when tuning improves SVM classifiers

For many machine learning algorithms, predictive performance is critical...
research
06/28/2020

K-Nearest Neighbour and Support Vector Machine Hybrid Classification

In this paper, a novel K-Nearest Neighbour and Support Vector Machine hy...
research
12/04/2019

Active Learning of SVDD Hyperparameter Values

Support Vector Data Description is a popular method for outlier detectio...
research
10/02/2020

An ensemble of Density based Geometric One-Class Classifier and Genetic Algorithm

One of the most rising issues in recent machine learning research is One...
research
12/07/2017

Perspectival Knowledge in PSOA RuleML: Representation, Model Theory, and Translation

In Positional-Slotted Object-Applicative (PSOA) RuleML, a predicate appl...

Please sign up or login with your details

Forgot password? Click here to reset