Learning to Predict Combinatorial Structures

12/22/2009
by   Shankar Vembu, et al.
0

The major challenge in designing a discriminative learning algorithm for predicting structured data is to address the computational issues arising from the exponential size of the output space. Existing algorithms make different assumptions to ensure efficient, polynomial time estimation of model parameters. For several combinatorial structures, including cycles, partially ordered sets, permutations and other graph classes, these assumptions do not hold. In this thesis, we address the problem of designing learning algorithms for predicting combinatorial structures by introducing two new assumptions: (i) The first assumption is that a particular counting problem can be solved efficiently. The consequence is a generalisation of the classical ridge regression for structured prediction. (ii) The second assumption is that a particular sampling problem can be solved efficiently. The consequence is a new technique for designing and analysing probabilistic structured prediction models. These results can be applied to solve several complex learning problems including but not limited to multi-label classification, multi-category hierarchical classification, and label ranking.

READ FULL TEXT

page 1

page 2

research
11/19/2015

Structured Prediction Energy Networks

We introduce structured prediction energy networks (SPENs), a flexible f...
research
02/14/2012

Conditional Restricted Boltzmann Machines for Structured Output Prediction

Conditional Restricted Boltzmann Machines (CRBMs) are rich probabilistic...
research
02/13/2018

Predict and Constrain: Modeling Cardinality in Deep Structured Prediction

Many machine learning problems require the prediction of multi-dimension...
research
02/01/2021

Fast rates in structured prediction

Discrete supervised learning problems such as classification are often t...
research
03/25/2010

Large Margin Boltzmann Machines and Large Margin Sigmoid Belief Networks

Current statistical models for structured prediction make simplifying as...
research
06/17/2014

Notes on hierarchical ensemble methods for DAG-structured taxonomies

Several real problems ranging from text classification to computational ...
research
07/21/2019

Logical Classification of Partially Ordered Data

Issues concerning intelligent data analysis occurring in machine learnin...

Please sign up or login with your details

Forgot password? Click here to reset