A Generalized Kernel Approach to Structured Output Learning

05/10/2012
by   Hachem Kadri, et al.
0

We study the problem of structured output learning from a regression perspective. We first provide a general formulation of the kernel dependency estimation (KDE) problem using operator-valued kernels. We show that some of the existing formulations of this problem are special cases of our framework. We then propose a covariance-based operator-valued kernel that allows us to take into account the structure of the kernel feature space. This kernel operates on the output space and encodes the interactions between the outputs without any reference to the input space. To address this issue, we introduce a variant of our KDE method based on the conditional covariance operator that in addition to the correlation between the outputs takes into account the effects of the input variables. Finally, we evaluate the performance of our KDE approach using both covariance and conditional covariance kernels on two structured output problems, and compare it to the state-of-the-art kernel-based structured output regression methods.

READ FULL TEXT
research
01/14/2021

Entangled Kernels – Beyond Separability

We consider the problem of operator-valued kernel learning and investiga...
research
02/17/2016

Robust Kernel (Cross-) Covariance Operators in Reproducing Kernel Hilbert Space toward Kernel Methods

To the best of our knowledge, there are no general well-founded robust m...
research
05/09/2017

Influence Function and Robust Variant of Kernel Canonical Correlation Analysis

Many unsupervised kernel methods rely on the estimation of the kernel co...
research
12/23/2020

Direct Estimation of Spinal Cobb Angles by Structured Multi-Output Regression

The Cobb angle that quantitatively evaluates the spinal curvature plays ...
research
01/12/2013

Functional Regularized Least Squares Classi cation with Operator-valued Kernels

Although operator-valued kernels have recently received increasing inter...
research
07/04/2017

Kernel Feature Selection via Conditional Covariance Minimization

We propose a framework for feature selection that employs kernel-based m...
research
06/26/2018

Manifold Structured Prediction

Structured prediction provides a general framework to deal with supervis...

Please sign up or login with your details

Forgot password? Click here to reset