A geometric perspective on functional outlier detection

09/14/2021
by   Moritz Herrmann, et al.
Universität München
0

We consider functional outlier detection from a geometric perspective, specifically: for functional data sets drawn from a functional manifold which is defined by the data's modes of variation in amplitude and phase. Based on this manifold, we develop a conceptualization of functional outlier detection that is more widely applicable and realistic than previously proposed. Our theoretical and experimental analyses demonstrate several important advantages of this perspective: It considerably improves theoretical understanding and allows to describe and analyse complex functional outlier scenarios consistently and in full generality, by differentiating between structurally anomalous outlier data that are off-manifold and distributionally outlying data that are on-manifold but at its margins. This improves practical feasibility of functional outlier detection: We show that simple manifold learning methods can be used to reliably infer and visualize the geometric structure of functional data sets. We also show that standard outlier detection methods requiring tabular data inputs can be applied to functional data very successfully by simply using their vector-valued representations learned from manifold learning methods as input features. Our experiments on synthetic and real data sets demonstrate that this approach leads to outlier detection performances at least on par with existing functional data-specific methods in a large variety of settings, without the highly specialized, complex methodology and narrow domain of application these methods often entail.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 17

page 36

10/02/2021

Functional outlier detection for density-valued data with application to robustify distribution to distribution regression

Distributional data analysis, concerned with statistical analysis and mo...
11/13/2018

Nonparametric geometric outlier detection

Outlier detection is a major topic in robust statistics due to the high ...
06/18/2018

Kernel-based Outlier Detection using the Inverse Christoffel Function

Outlier detection methods have become increasingly relevant in recent ye...
12/16/2019

Detecting and Classifying Outliers in Big Functional Data

This paper proposes two new outlier detection methods, which are useful ...
12/13/2017

Multiple testing for outlier detection in functional data

We propose a novel procedure for outlier detection in functional data, i...
06/05/2017

The Geometry of Nodal Sets and Outlier Detection

Let (M,g) be a compact manifold and let -Δϕ_k = λ_k ϕ_k be the sequence ...
09/18/2020

Identification of Abnormal States in Videos of Ants Undergoing Social Phase Change

Biology is both an important application area and a source of motivation...

Code Repositories

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.