Hinge-loss Markov Random Fields: Convex Inference for Structured Prediction

09/26/2013
by   Stephen Bach, et al.
0

Graphical models for structured domains are powerful tools, but the computational complexities of combinatorial prediction spaces can force restrictions on models, or require approximate inference in order to be tractable. Instead of working in a combinatorial space, we use hinge-loss Markov random fields (HL-MRFs), an expressive class of graphical models with log-concave density functions over continuous variables, which can represent confidences in discrete predictions. This paper demonstrates that HL-MRFs are general tools for fast and accurate structured prediction. We introduce the first inference algorithm that is both scalable and applicable to the full class of HL-MRFs, and show how to train HL-MRFs with several learning algorithms. Our experiments show that HL-MRFs match or surpass the predictive performance of state-of-the-art methods, including discrete models, in four application domains.

READ FULL TEXT
research
11/17/2010

An Introduction to Conditional Random Fields

Often we wish to predict a large number of variables that depend on each...
research
05/17/2015

Hinge-Loss Markov Random Fields and Probabilistic Soft Logic

A fundamental challenge in developing high-impact machine learning techn...
research
05/24/2016

Local Perturb-and-MAP for Structured Prediction

Conditional random fields (CRFs) provide a powerful tool for structured ...
research
10/26/2020

Parallel Inference on Structured Data with CRFs on GPUs

Structured real world data can be represented with graphs whose structur...
research
02/18/2020

Deep Gaussian Markov random fields

Gaussian Markov random fields (GMRFs) are probabilistic graphical models...
research
12/06/2021

Graphical Models with Attention for Context-Specific Independence and an Application to Perceptual Grouping

Discrete undirected graphical models, also known as Markov Random Fields...
research
11/09/2018

Block Belief Propagation for Parameter Learning in Markov Random Fields

Traditional learning methods for training Markov random fields require d...

Please sign up or login with your details

Forgot password? Click here to reset