DeepAI AI Chat
Log In Sign Up

Auto-associative models, nonlinear Principal component analysis, manifolds and projection pursuit

03/31/2011
by   Stéphane Girard, et al.
University Lille 1: Sciences and Technologies
inrialpes.fr
0

In this paper, auto-associative models are proposed as candidates to the generalization of Principal Component Analysis. We show that these models are dedicated to the approximation of the dataset by a manifold. Here, the word "manifold" refers to the topology properties of the structure. The approximating manifold is built by a projection pursuit algorithm. At each step of the algorithm, the dimension of the manifold is incremented. Some theoretical properties are provided. In particular, we can show that, at each step of the algorithm, the mean residuals norm is not increased. Moreover, it is also established that the algorithm converges in a finite number of steps. Some particular auto-associative models are exhibited and compared to the classical PCA and some neural networks models. Implementation aspects are discussed. We show that, in numerous cases, no optimization procedure is required. Some illustrations on simulated and real data are presented.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/28/2019

A robust approach for principal component analyisis

In this paper we analyze different ways of performing principal componen...
09/20/2012

Probabilistic Auto-Associative Models and Semi-Linear PCA

Auto-Associative models cover a large class of methods used in data anal...
11/10/2019

Manifold Denoising by Nonlinear Robust Principal Component Analysis

This paper extends robust principal component analysis (RPCA) to nonline...
02/22/2016

Principal Component Projection Without Principal Component Analysis

We show how to efficiently project a vector onto the top principal compo...
08/16/2016

Parameterized Principal Component Analysis

When modeling multivariate data, one might have an extra parameter of co...
01/09/2018

Complex and Quaternionic Principal Component Pursuit and Its Application to Audio Separation

Recently, the principal component pursuit has received increasing attent...
01/03/2023

Diffusion approximations of Oja's online principal component analysis

Oja's algorithm of principal component analysis (PCA) has been one of th...