Johnson-Lindenstrauss Property Implies Subspace Restricted Isometry Property

05/23/2019
by   Xingyu Xv, et al.
0

Dimensionality reduction is a popular approach to tackle high-dimensional data with low-dimensional nature. Subspace Restricted Isometry Property, a newly-proposed concept, has proved to be a useful tool in analyzing the effect of dimensionality reduction algorithms on subspaces. In this paper, we establish the subspace Restricted Isometry Property for random projections satisfying some specific concentration inequality, which is called by Johnson-Lindenstrauss property. Johnson-Lindenstrauss property is a very mild condition and is satisfied by numerous types of random matrices encountered in practice. Thus our result could extend the applicability of random projections in subspace-based machine learning algorithms including subspace clustering and allow for the usage of, for instance, Bernoulli matrices, partial Fourier matrices, and partial Hadamard matrices for random projections, which are easier to implement on hardware or are more efficient to compute.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2014

Subspace clustering of dimensionality-reduced data

Subspace clustering refers to the problem of clustering unlabeled high-d...
research
02/16/2017

RIPML: A Restricted Isometry Property based Approach to Multilabel Learning

The multilabel learning problem with large number of labels, features, a...
research
07/14/2019

Compressed Subspace Learning Based on Canonical Angle Preserving Property

A standard way to tackle the challenging task of learning from high-dime...
research
03/30/2018

Fast and Robust Subspace Clustering Using Random Projections

Over the past several decades, subspace clustering has been receiving in...
research
06/18/2020

Precise expressions for random projections: Low-rank approximation and randomized Newton

It is often desirable to reduce the dimensionality of a large dataset by...
research
04/11/2019

Restricted Isometry Property under High Correlations

Matrices satisfying the Restricted Isometry Property (RIP) play an impor...
research
02/17/2014

Dimensionality reduction with subgaussian matrices: a unified theory

We present a theory for Euclidean dimensionality reduction with subgauss...

Please sign up or login with your details

Forgot password? Click here to reset