Theoretical Properties of Projection Based Multilayer Perceptrons with Functional Inputs

04/01/2006
by   Fabrice Rossi, et al.
0

Many real world data are sampled functions. As shown by Functional Data Analysis (FDA) methods, spectra, time series, images, gesture recognition data, etc. can be processed more efficiently if their functional nature is taken into account during the data analysis process. This is done by extending standard data analysis methods so that they can apply to functional inputs. A general way to achieve this goal is to compute projections of the functional data onto a finite dimensional sub-space of the functional space. The coordinates of the data on a basis of this sub-space provide standard vector representations of the functions. The obtained vectors can be processed by any standard method. In our previous work, this general approach has been used to define projection based Multilayer Perceptrons (MLPs) with functional inputs. We study in this paper important theoretical properties of the proposed model. We show in particular that MLPs with functional inputs are universal approximators: they can approximate to arbitrary accuracy any continuous mapping from a compact sub-space of a functional space to R. Moreover, we provide a consistency result that shows that any mapping from a functional space to R can be learned thanks to examples by a projection based MLP: the generalization mean square error of the MLP decreases to the smallest possible mean square error on the data when the number of examples goes to infinity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/02/2007

Support vector machine for functional data classification

In many applications, input data are sampled functions taking their valu...
research
03/12/2021

Machine Learning Assisted Orthonormal Basis Selection for Functional Data Analysis

In implementations of the functional data methods, the effect of the ini...
research
03/03/2020

Nonlinear Functional Output Regression: a Dictionary Approach

Many applications in signal processing involve data that consists in a h...
research
01/04/2012

Constrained variable clustering and the best basis problem in functional data analysis

Functional data analysis involves data described by regular functions ra...
research
01/01/2018

Least Square Error Method Robustness of Computation: What is not usually considered and taught

There are many practical applications based on the Least Square Error (L...
research
12/13/2017

ROAST: Rapid Orthogonal Approximate Slepian Transform

In this paper, we provide a Rapid Orthogonal Approximate Slepian Transfo...
research
04/28/2022

Improving the estimation of directional area scattering factor (DASF) from canopy reflectance: theoretical basis and validation

Directional area scattering factor (DASF) is a critical canopy structura...

Please sign up or login with your details

Forgot password? Click here to reset