Unsupervised Functional Data Analysis via Nonlinear Dimension Reduction

12/22/2020
by   Moritz Herrmann, et al.
0

In recent years, manifold methods have moved into focus as tools for dimension reduction. Assuming that the high-dimensional data actually lie on or close to a low-dimensional nonlinear manifold, these methods have shown convincing results in several settings. This manifold assumption is often reasonable for functional data, i.e., data representing continuously observed functions, as well. However, the performance of manifold methods recently proposed for tabular or image data has not been systematically assessed in the case of functional data yet. Moreover, it is unclear how to evaluate the quality of learned embeddings that do not yield invertible mappings, since the reconstruction error cannot be used as a performance measure for such representations. In this work, we describe and investigate the specific challenges for nonlinear dimension reduction posed by the functional data setting. The contributions of the paper are three-fold: First of all, we define a theoretical framework which allows to systematically assess specific challenges that arise in the functional data context, transfer several nonlinear dimension reduction methods for tabular and image data to functional data, and show that manifold methods can be used successfully in this setting. Secondly, we subject performance assessment and tuning strategies to a thorough and systematic evaluation based on several different functional data settings and point out some previously undescribed weaknesses and pitfalls which can jeopardize reliable judgment of embedding quality. Thirdly, we propose a nuanced approach to make trustworthy decisions for or against competing nonconforming embeddings more objectively.

READ FULL TEXT
research
06/23/2023

Learning latent representations in high-dimensional state spaces using polynomial manifold constructions

We present a novel framework for learning cost-efficient latent represen...
research
05/20/2023

Contrastive inverse regression for dimension reduction

Supervised dimension reduction (SDR) has been a topic of growing interes...
research
07/29/2011

A Invertible Dimension Reduction of Curves on a Manifold

In this paper, we propose a novel lower dimensional representation of a ...
research
05/26/2015

Using Dimension Reduction to Improve the Classification of High-dimensional Data

In this work we show that the classification performance of high-dimensi...
research
04/19/2020

A Dimension-Reduction Model for Brittle Fractures on Thin Shells with Mesh Adaptivity

In this paper we derive a new two-dimensional brittle fracture model for...
research
06/24/2009

On landmark selection and sampling in high-dimensional data analysis

In recent years, the spectral analysis of appropriately defined kernel m...
research
06/02/2021

Matrix factorisation and the interpretation of geodesic distance

Given a graph or similarity matrix, we consider the problem of recoverin...

Please sign up or login with your details

Forgot password? Click here to reset