When is there a Representer Theorem? Reflexive Banach spaces

09/26/2018
by   Kevin Schlegel, et al.
0

We consider a general regularised interpolation problem for learning a parameter vector from data. The well known representer theorem says that under certain conditions on the regulariser there exists a solution in the linear span of the data points. This is the core of kernel methods in machine learning as it makes the problem computationally tractable. Most literature deals only with sufficient conditions for representer theorems in Hilbert spaces. We prove necessary and sufficient conditions for the existence of representer theorems in reflexive Banach spaces and illustrate why in a sense reflexivity is the minimal requirement on the function space. We further show that if the learning relies on the linear representer theorem the solution is independent of the regulariser and in fact determined by the function space alone. This in particular shows the value of generalising Hilbert space learning theory to Banach spaces.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/25/2018

When is there a Representer Theorem? Nondifferentiable Regularisers and Banach spaces

We consider a general regularised interpolation problem for learning a p...
research
11/01/2019

Approximate Representer Theorems in Non-reflexive Banach Spaces

The representer theorem is one of the most important mathematical founda...
research
05/01/2014

A Structural Approach to Coordinate-Free Statistics

We consider the question of learning in general topological vector space...
research
04/07/2023

Representer Theorems for Metric and Preference Learning: A Geometric Perspective

We explore the metric and preference learning problem in Hilbert spaces....
research
12/23/2017

Cointegration and representation of integrated autoregressive processes in function spaces

We provide a suitable generalization of cointegration for time series ta...
research
09/19/2018

A Generalized Representer Theorem for Hilbert Space - Valued Functions

The necessary and sufficient conditions for existence of a generalized r...
research
05/28/2019

NIL: Learning Nonlinear Interpolants

Nonlinear interpolants have been shown useful for the verification of pr...

Please sign up or login with your details

Forgot password? Click here to reset