Unsupervised Functional Data Analysis via Nonlinear Dimension Reduction

12/22/2020
by   Moritz Herrmann, et al.
0

In recent years, manifold methods have moved into focus as tools for dimension reduction. Assuming that the high-dimensional data actually lie on or close to a low-dimensional nonlinear manifold, these methods have shown convincing results in several settings. This manifold assumption is often reasonable for functional data, i.e., data representing continuously observed functions, as well. However, the performance of manifold methods recently proposed for tabular or image data has not been systematically assessed in the case of functional data yet. Moreover, it is unclear how to evaluate the quality of learned embeddings that do not yield invertible mappings, since the reconstruction error cannot be used as a performance measure for such representations. In this work, we describe and investigate the specific challenges for nonlinear dimension reduction posed by the functional data setting. The contributions of the paper are three-fold: First of all, we define a theoretical framework which allows to systematically assess specific challenges that arise in the functional data context, transfer several nonlinear dimension reduction methods for tabular and image data to functional data, and show that manifold methods can be used successfully in this setting. Secondly, we subject performance assessment and tuning strategies to a thorough and systematic evaluation based on several different functional data settings and point out some previously undescribed weaknesses and pitfalls which can jeopardize reliable judgment of embedding quality. Thirdly, we propose a nuanced approach to make trustworthy decisions for or against competing nonconforming embeddings more objectively.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 19

07/29/2011

A Invertible Dimension Reduction of Curves on a Manifold

In this paper, we propose a novel lower dimensional representation of a ...
05/26/2015

Using Dimension Reduction to Improve the Classification of High-dimensional Data

In this work we show that the classification performance of high-dimensi...
03/11/2021

Modern Dimension Reduction

Data are not only ubiquitous in society, but are increasingly complex bo...
03/12/2015

Functional Inverse Regression in an Enlarged Dimension Reduction Space

We consider an enlarged dimension reduction space in functional inverse ...
06/02/2021

Matrix factorisation and the interpretation of geodesic distance

Given a graph or similarity matrix, we consider the problem of recoverin...
04/19/2020

A Dimension-Reduction Model for Brittle Fractures on Thin Shells with Mesh Adaptivity

In this paper we derive a new two-dimensional brittle fracture model for...
06/16/2008

Local Procrustes for Manifold Embedding: A Measure of Embedding Quality and Embedding Algorithms

We present the Procrustes measure, a novel measure based on Procrustes r...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.