Stability of Multi-Task Kernel Regression Algorithms

06/17/2013
by   Julien Audiffren, et al.
0

We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonscalar outputs like multi-task learning and structured out- put prediction. We show that multi-task kernel regression algorithms are uniformly stable in the general case of infinite-dimensional output spaces. We then derive under mild assumption on the kernel generaliza- tion bounds of such algorithms, and we show their consistency even with non Hilbert-Schmidt operator-valued kernels . We demonstrate how to apply the results to various multi-task kernel regression methods such as vector-valued SVR and functional ridge regression.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/04/2011

Vector-valued Reproducing Kernel Banach Spaces with Applications to Multi-task Learning

Motivated by multi-task machine learning with Banach spaces, we propose ...
research
10/10/2019

On the Dualization of Operator-Valued Kernel Machines

Operator-Valued Kernels (OVKs) and Vector-Valued Reproducing Kernel Hilb...
research
03/07/2012

Multiple Operator-valued Kernel Learning

Positive definite operator-valued kernels generalize the well-known noti...
research
01/12/2013

Functional Regularized Least Squares Classi cation with Operator-valued Kernels

Although operator-valued kernels have recently received increasing inter...
research
08/20/2020

No-regret Algorithms for Multi-task Bayesian Optimization

We consider multi-objective optimization (MOO) of an unknown vector-valu...
research
02/21/2016

Multi-task and Lifelong Learning of Kernels

We consider a problem of learning kernels for use in SVM classification ...
research
05/04/2020

Reduced Rank Multivariate Kernel Ridge Regression

In the multivariate regression, also referred to as multi-task learning ...

Please sign up or login with your details

Forgot password? Click here to reset