Large-scale Distance Metric Learning with Uncertainty

05/25/2018
by   Qi Qian, et al.
0

Distance metric learning (DML) has been studied extensively in the past decades for its superior performance with distance-based algorithms. Most of the existing methods propose to learn a distance metric with pairwise or triplet constraints. However, the number of constraints is quadratic or even cubic in the number of the original examples, which makes it challenging for DML to handle the large-scale data set. Besides, the real-world data may contain various uncertainty, especially for the image data. The uncertainty can mislead the learning procedure and cause the performance degradation. By investigating the image data, we find that the original data can be observed from a small set of clean latent examples with different distortions. In this work, we propose the margin preserving metric learning framework to learn the distance metric and latent examples simultaneously. By leveraging the ideal properties of latent examples, the training efficiency can be improved significantly while the learned metric also becomes robust to the uncertainty in the original data. Furthermore, we can show that the metric is learned from latent examples only, but it can preserve the large margin property even for the original data. The empirical study on the benchmark image data sets demonstrates the efficacy and efficiency of the proposed method.

READ FULL TEXT
research
06/20/2012

Bayesian Active Distance Metric Learning

Distance metric learning is an important component for many tasks, such ...
research
04/24/2014

Scalable Similarity Learning using Large Margin Neighborhood Embedding

Classifying large-scale image data into object categories is an importan...
research
09/11/2019

SoftTriple Loss: Deep Metric Learning Without Triplet Sampling

Distance metric learning (DML) is to learn the embeddings where examples...
research
03/15/2012

Robust Metric Learning by Smooth Optimization

Most existing distance metric learning methods assume perfect side infor...
research
04/08/2016

Bayesian Neighbourhood Component Analysis

Learning a good distance metric in feature space potentially improves th...
research
07/04/2014

Improving Performance of Self-Organising Maps with Distance Metric Learning Method

Self-Organising Maps (SOM) are Artificial Neural Networks used in Patter...
research
12/25/2017

Kernel Regression with Sparse Metric Learning

Kernel regression is a popular non-parametric fitting technique. It aims...

Please sign up or login with your details

Forgot password? Click here to reset