Feature space transformations and model selection to improve the performance of classifiers

07/14/2019
by   Jose Ortiz-Bejar, et al.
0

Improving the performance of classifiers is the realm of prototype selection and kernel transformations. Prototype selection has been used to reduce the space complexity of k-Nearest Neighbors classifiers and to improve its accuracy, and kernel transformations enhanced the performance of linear classifiers by converting a non-linear separable problem into a linear one in the transformed space. Our proposal combines, in a model selection scheme, these transformations with classic algorithms such as Naïve Bayes and k-Nearest Neighbors to produce a competitive classifier. We analyzed our approach on different classification problems and compared it to state-of-the-art classifiers. The results show that the methodology proposed is competitive, obtaining the lowest rank among the classifiers being compared.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2018

Analyzing different prototype selection techniques for dynamic classifier and ensemble selection

In dynamic selection (DS) techniques, only the most competent classifier...
research
10/15/2020

On Convergence of Nearest Neighbor Classifiers over Feature Transformations

The k-Nearest Neighbors (kNN) classifier is a fundamental non-parametric...
research
07/22/2022

Multilabel Prototype Generation for Data Reduction in k-Nearest Neighbour classification

Prototype Generation (PG) methods are typically considered for improving...
research
10/14/2016

Generalization Error of Invariant Classifiers

This paper studies the generalization error of invariant classifiers. In...
research
06/21/2016

Kernel-based Generative Learning in Distortion Feature Space

This paper presents a novel kernel-based generative classifier which is ...
research
07/16/2019

Selection Heuristics on Semantic Genetic Programming for Classification Problems

In a steady-state evolution, tournament selection traditionally uses the...
research
12/17/2004

Less is More - Genetic Optimisation of Nearest Neighbour Classifiers

The present paper deals with optimisation of Nearest Neighbour rule Clas...

Please sign up or login with your details

Forgot password? Click here to reset