RIPML: A Restricted Isometry Property based Approach to Multilabel Learning

02/16/2017
by   Akshay Soni, et al.
0

The multilabel learning problem with large number of labels, features, and data-points has generated a tremendous interest recently. A recurring theme of these problems is that only a few labels are active in any given datapoint as compared to the total number of labels. However, only a small number of existing work take direct advantage of this inherent extreme sparsity in the label space. By the virtue of Restricted Isometry Property (RIP), satisfied by many random ensembles, we propose a novel procedure for multilabel learning known as RIPML. During the training phase, in RIPML, labels are projected onto a random low-dimensional subspace followed by solving a least-square problem in this subspace. Inference is done by a k-nearest neighbor (kNN) based approach. We demonstrate the effectiveness of RIPML by conducting extensive simulations and comparing results with the state-of-the-art linear dimensionality reduction based approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2019

Johnson-Lindenstrauss Property Implies Subspace Restricted Isometry Property

Dimensionality reduction is a popular approach to tackle high-dimensiona...
research
12/06/2018

SqueezeFit: Label-aware dimensionality reduction by semidefinite programming

Given labeled points in a high-dimensional vector space, we seek a low-d...
research
07/13/2022

Online Active Regression

Active regression considers a linear regression problem where the learne...
research
05/16/2014

Optimized Cartesian K-Means

Product quantization-based approaches are effective to encode high-dimen...
research
02/06/2014

Dissimilarity-based Ensembles for Multiple Instance Learning

In multiple instance learning, objects are sets (bags) of feature vector...
research
11/21/2022

An Optimal k Nearest Neighbours Ensemble for Classification Based on Extended Neighbourhood Rule with Features subspace

To minimize the effect of outliers, kNN ensembles identify a set of clos...

Please sign up or login with your details

Forgot password? Click here to reset