DeepAI AI Chat
Log In Sign Up

Train and Test Tightness of LP Relaxations in Structured Prediction

11/04/2015
by   Ofer Meshi, et al.
0

Structured prediction is used in areas such as computer vision and natural language processing to predict structured outputs such as segmentations or parse trees. In these settings, prediction is performed by MAP inference or, equivalently, by solving an integer linear program. Because of the complex scoring functions required to obtain accurate predictions, both learning and inference typically require the use of approximate solvers. We propose a theoretical explanation to the striking observation that approximations based on linear programming (LP) relaxations are often tight on real-world instances. In particular, we show that learning with LP relaxed inference encourages integrality of training instances, and that tightness generalizes from train to test data.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/26/2021

Beyond Perturbation Stability: LP Recovery Guarantees for MAP Inference on Noisy Stable Instances

Several works have shown that perturbation stable instances of the MAP i...
01/13/2020

LP-SparseMAP: Differentiable Relaxed Optimization for Sparse Structured Prediction

Structured prediction requires manipulating a large number of combinator...
01/17/2022

Learning to Reformulate for Linear Programming

It has been verified that the linear programming (LP) is able to formula...
03/09/2021

Efficient Algorithms for Global Inference in Internet Marketplaces

Matching demand to supply in internet marketplaces (e-commerce, ride-sha...
11/06/2017

Alpha-expansion is Exact on Stable Instances

Approximate algorithms for structured prediction problems---such as the ...
08/14/2013

Compact Relaxations for MAP Inference in Pairwise MRFs with Piecewise Linear Priors

Label assignment problems with large state spaces are important tasks es...
11/27/2020

Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete Verifiers

Formal verification of neural networks (NNs) is a challenging and import...