Positive Semidefinite Metric Learning with Boosting

10/13/2009
by   Chunhua Shen, et al.
0

The learning of appropriate distance metrics is a critical problem in image classification and retrieval. In this work, we propose a boosting-based technique, termed , for learning a Mahalanobis distance metric. One of the primary difficulties in learning such a metric is to ensure that the Mahalanobis matrix remains positive semidefinite. Semidefinite programming is sometimes used to enforce this constraint, but does not scale well. is instead based on a key observation that any positive semidefinite matrix can be decomposed into a linear positive combination of trace-one rank-one matrices. thus uses rank-one positive semidefinite matrices as weak learners within an efficient and scalable boosting-based learning process. The resulting method is easy to implement, does not require tuning, and can accommodate various types of constraints. Experiments on various datasets show that the proposed algorithm compares favorably to those state-of-the-art methods in terms of classification accuracy and running time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/25/2011

Positive Semidefinite Metric Learning Using Boosting-like Algorithms

The success of many machine learning and pattern recognition methods rel...
research
12/10/2015

Boosted Sparse Non-linear Distance Metric Learning

This paper proposes a boosting-based solution addressing metric learning...
research
03/02/2010

Scalable Large-Margin Mahalanobis Distance Metric Learning

For many machine learning algorithms such as k-Nearest Neighbor (k-NN) c...
research
04/28/2020

Denise: Deep Learning based Robust PCA for Positive Semidefinite Matrices

We introduce Denise, a deep learning based algorithm for decomposing pos...
research
11/23/2018

On polyhedral approximations of the positive semidefinite cone

Let D be the set of n× n positive semidefinite matrices of trace equal t...
research
08/07/2018

Approximations of Schatten Norms via Taylor Expansions

In this paper we consider symmetric, positive semidefinite (SPSD) matrix...
research
08/12/2021

Matrix pencils with coefficients that have positive semidefinite Hermitian part

We analyze when an arbitrary matrix pencil is equivalent to a dissipativ...

Please sign up or login with your details

Forgot password? Click here to reset