Spline Estimation of Functional Principal Components via Manifold Conjugate Gradient Algorithm

11/09/2022
by   Shiyuan He, et al.
0

Functional principal component analysis has become the most important dimension reduction technique in functional data analysis. Based on B-spline approximation, functional principal components (FPCs) can be efficiently estimated by the expectation-maximization (EM) and the geometric restricted maximum likelihood (REML) algorithms under the strong assumption of Gaussianity on the principal component scores and observational errors. When computing the solution, the EM algorithm does not exploit the underlying geometric manifold structure, while the performance of REML is known to be unstable. In this article, we propose a conjugate gradient algorithm over the product manifold to estimate FPCs. This algorithm exploits the manifold geometry structure of the overall parameter space, thus improving its search efficiency and estimation accuracy. In addition, a distribution-free interpretation of the loss function is provided from the viewpoint of matrix Bregman divergence, which explains why the proposed method works well under general distribution settings. We also show that a roughness penalization can be easily incorporated into our algorithm with a potentially better fit. The appealing numerical performance of the proposed method is demonstrated by simulation studies and the analysis of a Type Ia supernova light curve dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/26/2023

Nonlinear Functional Principal Component Analysis Using Neural Networks

Functional principal component analysis (FPCA) is an important technique...
research
06/12/2022

smoothEM: a new approach for the simultaneous assessment of smooth patterns and spikes

We consider functional data where an underlying smooth curve is composed...
research
09/03/2022

Geometry of EM and related iterative algorithms

The Expectation–Maximization (EM) algorithm is a simple meta-algorithm t...
research
09/20/2023

Principal component analysis in Bayes spaces for sparsely sampled density functions

This paper presents a novel approach to functional principal component a...
research
06/18/2019

Estimating a Manifold from a Tangent Bundle Learner

Manifold hypotheses are typically used for tasks such as dimensionality ...
research
08/24/2022

Discovering latent topology and geometry in data: a law of large dimension

Complex topological and geometric patterns often appear embedded in high...
research
07/28/2019

Multi-Rank Sparse and Functional PCA: Manifold Optimization and Iterative Deflation Techniques

We consider the problem of estimating multiple principal components usin...

Please sign up or login with your details

Forgot password? Click here to reset