Large Margin Boltzmann Machines and Large Margin Sigmoid Belief Networks

03/25/2010
by   Xu Miao, et al.
0

Current statistical models for structured prediction make simplifying assumptions about the underlying output graph structure, such as assuming a low-order Markov chain, because exact inference becomes intractable as the tree-width of the underlying graph increases. Approximate inference algorithms, on the other hand, force one to trade off representational power with computational efficiency. In this paper, we propose two new types of probabilistic graphical models, large margin Boltzmann machines (LMBMs) and large margin sigmoid belief networks (LMSBNs), for structured prediction. LMSBNs in particular allow a very fast inference algorithm for arbitrary graph structures that runs in polynomial time with a high probability. This probability is data-distribution dependent and is maximized in learning. The new approach overcomes the representation-efficiency trade-off in previous models and allows fast structured prediction with complicated graph structures. We present results from applying a fully connected model to multi-label scene classification and demonstrate that the proposed approach can yield significant performance gains over current state-of-the-art methods.

READ FULL TEXT

page 2

page 11

research
11/07/2018

Distributionally Robust Graphical Models

In many structured prediction problems, complex relationships between va...
research
09/26/2013

Learning Max-Margin Tree Predictors

Structured prediction is a powerful framework for coping with joint pred...
research
03/02/2017

Belief Propagation in Conditional RBMs for Structured Prediction

Restricted Boltzmann machines (RBMs) and conditional RBMs (CRBMs) are po...
research
06/09/2009

Large-Margin kNN Classification Using a Deep Encoder Network

KNN is one of the most popular classification methods, but it often fail...
research
11/12/2018

Universal Marginalizer for Amortised Inference and Embedding of Generative Models

Probabilistic graphical models are powerful tools which allow us to form...
research
08/06/2012

Structured Prediction Cascades

Structured prediction tasks pose a fundamental trade-off between the nee...
research
12/22/2009

Learning to Predict Combinatorial Structures

The major challenge in designing a discriminative learning algorithm for...

Please sign up or login with your details

Forgot password? Click here to reset