Random Forests for Metric Learning with Implicit Pairwise Position Dependence

01/03/2012
by   Caiming Xiong, et al.
0

Metric learning makes it plausible to learn distances for complex distributions of data from labeled data. However, to date, most metric learning methods are based on a single Mahalanobis metric, which cannot handle heterogeneous data well. Those that learn multiple metrics throughout the space have demonstrated superior accuracy, but at the cost of computational efficiency. Here, we take a new angle to the metric learning problem and learn a single metric that is able to implicitly adapt its distance function throughout the feature space. This metric adaptation is accomplished by using a random forest-based classifier to underpin the distance function and incorporate both absolute pairwise position and standard relative position into the representation. We have implemented and tested our method against state of the art global and multi-metric methods on a variety of data sets. Overall, the proposed method outperforms both types of methods in terms of accuracy (consistently ranked first) and is an order of magnitude faster than state of the art multi-metric methods (16x faster in the worst case).

READ FULL TEXT
research
06/11/2018

A Fast and Easy Regression Technique for k-NN Classification Without Using Negative Pairs

This paper proposes an inexpensive way to learn an effective dissimilari...
research
04/26/2019

Robust Metric Learning based on the Rescaled Hinge Loss

Distance/Similarity learning is a fundamental problem in machine learnin...
research
03/15/2012

Robust Metric Learning by Smooth Optimization

Most existing distance metric learning methods assume perfect side infor...
research
01/10/2019

Multi-feature Distance Metric Learning for Non-rigid 3D Shape Retrieval

In the past decades, feature-learning-based 3D shape retrieval approache...
research
06/10/2021

Distance Metric Learning through Minimization of the Free Energy

Distance metric learning has attracted a lot of interest for solving mac...
research
03/30/2020

Secure Metric Learning via Differential Pairwise Privacy

Distance Metric Learning (DML) has drawn much attention over the last tw...
research
02/03/2020

Distance Metric Learning for Graph Structured Data

Graphs are versatile tools for representing structured data. Therefore, ...

Please sign up or login with your details

Forgot password? Click here to reset