Adaptive Nearest Neighbor: A General Framework for Distance Metric Learning

11/22/2019
by   Kun Song, et al.
0

K-NN classifier is one of the most famous classification algorithms, whose performance is crucially dependent on the distance metric. When we consider the distance metric as a parameter of K-NN, learning an appropriate distance metric for K-NN can be seen as minimizing the empirical risk of K-NN. In this paper, we design a new type of continuous decision function of the K-NN classification rule which can be used to construct the continuous empirical risk function of K-NN. By minimizing this continuous empirical risk function, we obtain a novel distance metric learning algorithm named as adaptive nearest neighbor (ANN). We have proved that the current algorithms such as the large margin nearest neighbor (LMNN), neighbourhood components analysis (NCA) and the pairwise constraint methods are special cases of the proposed ANN by setting the parameter different values. Compared with the LMNN, NCA, and pairwise constraint methods, our method has a broader searching space which may contain better solutions. At last, extensive experiments on various data sets are conducted to demonstrate the effectiveness and efficiency of the proposed method.

READ FULL TEXT
research
06/24/2007

Metric Embedding for Nearest Neighbor Classification

The distance metric plays an important role in nearest neighbor (NN) cla...
research
03/05/2018

Local Distance Metric Learning for Nearest Neighbor Algorithm

Distance metric learning is a successful way to enhance the performance ...
research
01/20/2022

Adaptive neighborhood Metric learning

In this paper, we reveal that metric learning would suffer from serious ...
research
03/02/2010

Scalable Large-Margin Mahalanobis Distance Metric Learning

For many machine learning algorithms such as k-Nearest Neighbor (k-NN) c...
research
06/11/2018

A Fast and Easy Regression Technique for k-NN Classification Without Using Negative Pairs

This paper proposes an inexpensive way to learn an effective dissimilari...
research
07/11/2016

Learning a metric for class-conditional KNN

Naive Bayes Nearest Neighbour (NBNN) is a simple and effective framework...

Please sign up or login with your details

Forgot password? Click here to reset