Learning Mahalanobis Metric Spaces via Geometric Approximation Algorithms

05/24/2019
by   Diego Ihara, et al.
0

Learning Mahalanobis metric spaces is an important problem that has found numerous applications. Several algorithms have been designed for this problem, including Information Theoretic Metric Learning (ITML) by [Davis et al. 2007] and Large Margin Nearest Neighbor (LMNN) classification by [Weinberger and Saul 2009]. We consider a formulation of Mahalanobis metric learning as an optimization problem, where the objective is to minimize the number of violated similarity/dissimilarity constraints. We show that for any fixed ambient dimension, there exists a fully polynomial-time approximation scheme (FPTAS) with nearlylinear running time. This result is obtained using tools from the theory of linear programming in low dimensions. We also discuss improvements of the algorithm in practice, and present experimental results on synthetic and real-world data sets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/13/2018

Algorithms for metric learning via contrastive embeddings

We study the problem of supervised learning a metric space under discrim...
research
03/02/2010

Scalable Large-Margin Mahalanobis Distance Metric Learning

For many machine learning algorithms such as k-Nearest Neighbor (k-NN) c...
research
09/11/2023

The Effect of Intrinsic Dimension on Metric Learning under Compression

Metric learning aims at finding a suitable distance metric over the inpu...
research
02/12/2020

On the I/O complexity of the k-nearest neighbor problem

We consider static, external memory indexes for exact and approximate ve...
research
01/18/2022

Improved Approximation and Scalability for Fair Max-Min Diversification

Given an n-point metric space (𝒳,d) where each point belongs to one of m...
research
01/23/2012

A metric learning perspective of SVM: on the relation of SVM and LMNN

Support Vector Machines, SVMs, and the Large Margin Nearest Neighbor alg...
research
11/04/2019

Metric Learning for Dynamic Text Classification

Traditional text classifiers are limited to predicting over a fixed set ...

Please sign up or login with your details

Forgot password? Click here to reset