Multiple Operator-valued Kernel Learning

03/07/2012
by   Hachem Kadri, et al.
0

Positive definite operator-valued kernels generalize the well-known notion of reproducing kernels, and are naturally adapted to multi-output learning situations. This paper addresses the problem of learning a finite linear combination of infinite-dimensional operator-valued kernels which are suitable for extending functional data analysis methods to nonlinear contexts. We study this problem in the case of kernel ridge regression for functional responses with an lr-norm constraint on the combination coefficients. The resulting optimization problem is more involved than those of multiple scalar-valued kernel learning since operator-valued kernels pose more technical and theoretical issues. We propose a multiple operator-valued kernel learning algorithm based on solving a system of linear operator equations by using a block coordinatedescent procedure. We experimentally validate our approach on a functional regression task in the context of finger movement prediction in brain-computer interfaces.

READ FULL TEXT
research
06/17/2013

Stability of Multi-Task Kernel Regression Algorithms

We study the stability properties of nonlinear multi-task regression in ...
research
10/28/2015

Operator-valued Kernels for Learning from Functional Response Data

In this paper we consider the problems of supervised classification and ...
research
01/14/2021

Entangled Kernels – Beyond Separability

We consider the problem of operator-valued kernel learning and investiga...
research
11/16/2022

Learning linear operators: Infinite-dimensional regression as a well-behaved non-compact inverse problem

We consider the problem of learning a linear operator θ between two Hilb...
research
01/12/2013

Functional Regularized Least Squares Classi cation with Operator-valued Kernels

Although operator-valued kernels have recently received increasing inter...
research
01/12/2013

Multiple functional regression with both discrete and continuous covariates

In this paper we present a nonparametric method for extending functional...
research
10/10/2019

On the Dualization of Operator-Valued Kernel Machines

Operator-Valued Kernels (OVKs) and Vector-Valued Reproducing Kernel Hilb...

Please sign up or login with your details

Forgot password? Click here to reset