Dimensionality Reduction with Subspace Structure Preservation

by   Devansh Arpit, et al.
University at Buffalo

Modeling data as being sampled from a union of independent subspaces has been widely applied to a number of real world applications. However, dimensionality reduction approaches that theoretically preserve this independence assumption have not been well studied. Our key contribution is to show that 2K projection vectors are sufficient for the independence preservation of any K class data sampled from a union of independent subspaces. It is this non-trivial observation that we use for designing our dimensionality reduction technique. In this paper, we propose a novel dimensionality reduction algorithm that theoretically preserves this structure for a given dataset. We support our theoretical analysis with empirical results on both synthetic and real world data achieving state-of-the-art results compared to popular dimensionality reduction techniques.


Homology-Preserving Dimensionality Reduction via Manifold Landmarking and Tearing

Dimensionality reduction is an integral part of data visualization. It i...

An Analysis of Random Projections in Cancelable Biometrics

With increasing concerns about security, the need for highly secure phys...

Dimensionality reduction with subgaussian matrices: a unified theory

We present a theory for Euclidean dimensionality reduction with subgauss...

Non-Linear Spectral Dimensionality Reduction Under Uncertainty

In this paper, we consider the problem of non-linear dimensionality redu...

Experiments with Random Projection

Recent theoretical work has identified random projection as a promising ...

Dimensionality reduction for click-through rate prediction: Dense versus sparse representation

In online advertising, display ads are increasingly being placed based o...

Extracting the main trend in a dataset: the Sequencer algorithm

Scientists aim to extract simplicity from observations of the complex wo...

Please sign up or login with your details

Forgot password? Click here to reset