DeepAI AI Chat
Log In Sign Up

Auto-associative models, nonlinear Principal component analysis, manifolds and projection pursuit

by   Stéphane Girard, et al.
University Lille 1: Sciences and Technologies

In this paper, auto-associative models are proposed as candidates to the generalization of Principal Component Analysis. We show that these models are dedicated to the approximation of the dataset by a manifold. Here, the word "manifold" refers to the topology properties of the structure. The approximating manifold is built by a projection pursuit algorithm. At each step of the algorithm, the dimension of the manifold is incremented. Some theoretical properties are provided. In particular, we can show that, at each step of the algorithm, the mean residuals norm is not increased. Moreover, it is also established that the algorithm converges in a finite number of steps. Some particular auto-associative models are exhibited and compared to the classical PCA and some neural networks models. Implementation aspects are discussed. We show that, in numerous cases, no optimization procedure is required. Some illustrations on simulated and real data are presented.


page 1

page 2

page 3

page 4


A robust approach for principal component analyisis

In this paper we analyze different ways of performing principal componen...

Probabilistic Auto-Associative Models and Semi-Linear PCA

Auto-Associative models cover a large class of methods used in data anal...

Manifold Denoising by Nonlinear Robust Principal Component Analysis

This paper extends robust principal component analysis (RPCA) to nonline...

Principal Component Projection Without Principal Component Analysis

We show how to efficiently project a vector onto the top principal compo...

Parameterized Principal Component Analysis

When modeling multivariate data, one might have an extra parameter of co...

Complex and Quaternionic Principal Component Pursuit and Its Application to Audio Separation

Recently, the principal component pursuit has received increasing attent...

Diffusion approximations of Oja's online principal component analysis

Oja's algorithm of principal component analysis (PCA) has been one of th...