k-Nearest Neighbour Classifiers – 2nd Edition

04/09/2020
by   Pádraig Cunningham, et al.
0

Perhaps the most straightforward classifier in the arsenal or machine learning techniques is the Nearest Neighbour Classifier – classification is achieved by identifying the nearest neighbours to a query example and using those neighbours to determine the class of the query. This approach to classification is of particular importance because issues of poor run-time performance is not such a problem these days with the computational power that is available. This paper presents an overview of techniques for Nearest Neighbour classification focusing on; mechanisms for assessing similarity (distance), computational issues in identifying nearest neighbours and mechanisms for reducing the dimension of the data. This paper is the second edition of a paper previously published as a technical report. Sections on similarity measures for time-series, retrieval speed-up and intrinsic dimensionality have been added. An Appendix is included providing access to Python code for the key methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2019

Sparse ℓ_1 and ℓ_2 Center Classifiers

The nearest-centroid classifier is a simple linear-time classifier based...
research
02/08/2020

Intrinsic Dimension Estimation via Nearest Constrained Subspace Classifier

We consider the problems of classification and intrinsic dimension estim...
research
02/20/2021

Elastic Similarity Measures for Multivariate Time Series Classification

Elastic similarity measures are a class of similarity measures specifica...
research
03/16/2023

Hubs and Hyperspheres: Reducing Hubness and Improving Transductive Few-shot Learning with Hyperspherical Embeddings

Distance-based classification is frequently used in transductive few-sho...
research
03/01/2017

Fast k-Nearest Neighbour Search via Prioritized DCI

Most exact methods for k-nearest neighbour search suffer from the curse ...
research
05/05/2013

Efficient Estimation of the number of neighbours in Probabilistic K Nearest Neighbour Classification

Probabilistic k-nearest neighbour (PKNN) classification has been introdu...
research
12/07/2020

Certified Robustness of Nearest Neighbors against Data Poisoning Attacks

Data poisoning attacks aim to corrupt a machine learning model via modif...

Please sign up or login with your details

Forgot password? Click here to reset