Online Multiple Kernel Learning for Structured Prediction

10/13/2010
by   André F. T. Martins, et al.
0

Despite the recent progress towards efficient multiple kernel learning (MKL), the structured output case remains an open research front. Current approaches involve repeatedly solving a batch learning problem, which makes them inadequate for large scale scenarios. We propose a new family of online proximal algorithms for MKL (as well as for group-lasso and variants thereof), which overcomes that drawback. We show regret, convergence, and generalization bounds for the proposed method. Experiments on handwriting recognition and dependency parsing testify for the successfulness of the approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2011

Structured Sparsity and Generalization

We present a data dependent generalization bound for a large class of re...
research
02/02/2013

Generalization Guarantees for a Binary Classification Framework for Two-Stage Multiple Kernel Learning

We present generalization bounds for the TS-MKL framework for two stage ...
research
09/08/2015

A Scalable and Extensible Framework for Superposition-Structured Models

In many learning tasks, structural models usually lead to better interpr...
research
08/22/2013

Online and stochastic Douglas-Rachford splitting method for large scale machine learning

Online and stochastic learning has emerged as powerful tool in large sca...
research
05/15/2022

Generalization Bounds on Multi-Kernel Learning with Mixed Datasets

This paper presents novel generalization bounds for the multi-kernel lea...
research
05/31/2021

Fine-grained Generalization Analysis of Structured Output Prediction

In machine learning we often encounter structured output prediction prob...
research
12/06/2013

Dual coordinate solvers for large-scale structural SVMs

This manuscript describes a method for training linear SVMs (including b...

Please sign up or login with your details

Forgot password? Click here to reset