Learning Maximum-A-Posteriori Perturbation Models for Structured Prediction in Polynomial Time

05/21/2018
by   Asish Ghoshal, et al.
0

MAP perturbation models have emerged as a powerful framework for inference in structured prediction. Such models provide a way to efficiently sample from the Gibbs distribution and facilitate predictions that are robust to random noise. In this paper, we propose a provably polynomial time randomized algorithm for learning the parameters of perturbed MAP predictors. Our approach is based on minimizing a novel Rademacher-based generalization bound on the expected loss of a perturbed MAP predictor, which can be computed in polynomial time. We obtain conditions under which our randomized learning algorithm can guarantee generalization to unseen examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2020

Learning Randomly Perturbed Structured Predictors for Direct Loss Minimization

Direct loss minimization is a popular approach for learning predictors o...
research
02/24/2020

Learning Structured Distributions From Untrusted Batches: Faster and Simpler

We revisit the problem of learning from untrusted batches introduced by ...
research
08/05/2015

Structured Prediction: From Gaussian Perturbations to Linear-Time Principled Algorithms

Margin-based structured prediction commonly uses a maximum loss over all...
research
08/04/2020

Recovering a perturbation of a matrix polynomial from a perturbation of its linearization

A number of theoretical and computational problems for matrix polynomial...
research
05/24/2023

Polynomial-Time Pseudodeterministic Construction of Primes

A randomized algorithm for a search problem is *pseudodeterministic* if ...
research
11/03/2021

Perturb-and-max-product: Sampling and learning in discrete energy-based models

Perturb-and-MAP offers an elegant approach to approximately sample from ...
research
10/01/2021

Approximate Bisimulation Minimisation

We propose polynomial-time algorithms to minimise labelled Markov chains...

Please sign up or login with your details

Forgot password? Click here to reset