Non-Linear Spectral Dimensionality Reduction Under Uncertainty

02/09/2022
by   Firas Laakom, et al.
7

In this paper, we consider the problem of non-linear dimensionality reduction under uncertainty, both from a theoretical and algorithmic perspectives. Since real-world data usually contain measurements with uncertainties and artifacts, the input space in the proposed framework consists of probability distributions to model the uncertainties associated with each sample. We propose a new dimensionality reduction framework, called NGEU, which leverages uncertainty information and directly extends several traditional approaches, e.g., KPCA, MDA/KMFA, to receive as inputs the probability distributions instead of the original data. We show that the proposed NGEU formulation exhibits a global closed-form solution, and we analyze, based on the Rademacher complexity, how the underlying uncertainties theoretically affect the generalization ability of the framework. Empirical results on different datasets show the effectiveness of the proposed framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2019

Uncertainty-Aware Principal Component Analysis

We present a technique to perform dimensionality reduction on data that ...
research
12/07/2014

Dimensionality Reduction with Subspace Structure Preservation

Modeling data as being sampled from a union of independent subspaces has...
research
10/18/2021

Dimensionality Reduction for Wasserstein Barycenter

The Wasserstein barycenter is a geometric construct which captures the n...
research
08/19/2020

On velocity and migration structural uncertainties: A new approach using non-linear slope tomography

Evaluating structural uncertainties associated with seismic imaging and ...
research
01/29/2018

Nonlinear Dimensionality Reduction on Graphs

In this era of data deluge, many signal processing and machine learning ...
research
10/31/2018

An Information-Theoretic Framework for Non-linear Canonical Correlation Analysis

Canonical Correlation Analysis (CCA) is a linear representation learning...
research
10/03/2017

DimReader: Using auto-differentiation to explain non-linear projections

Non-linear dimensionality reduction (NDR) methods such as LLE and t-SNE ...

Please sign up or login with your details

Forgot password? Click here to reset