Automorphism Groups of Graphical Models and Lifted Variational Inference

09/26/2013
by   Hung Bui, et al.
0

Using the theory of group action, we first introduce the concept of the automorphism group of an exponential family or a graphical model, thus formalizing the general notion of symmetry of a probabilistic model. This automorphism group provides a precise mathematical framework for lifted inference in the general exponential family. Its group action partitions the set of random variables and feature functions into equivalent classes (called orbits) having identical marginals and expectations. Then the inference problem is effectively reduced to that of computing marginals or expectations for each class, thus avoiding the need to deal with each individual variable or feature. We demonstrate the usefulness of this general framework in lifting two classes of variational approximation for maximum a posteriori (MAP) inference: local linear programming (LP) relaxation and local LP relaxation with cycle constraints; the latter yields the first lifted variational inference algorithm that operates on a bound tighter than the local constraints.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2019

MAP Inference via L2-Sphere Linear Program Reformulation

Maximum a posteriori (MAP) inference is an important task for graphical ...
research
06/17/2014

Lifted Tree-Reweighted Variational Inference

We analyze variational inference for highly symmetric graphical models s...
research
09/25/2017

Exact MAP inference in general higher-order graphical models using linear programming

This paper is concerned with the problem of exact MAP inference in gener...
research
07/02/2019

Approximate Sherali-Adams Relaxations for MAP Inference via Entropy Regularization

Maximum a posteriori (MAP) inference is a fundamental computational para...
research
04/10/2016

Correlated Equilibria for Approximate Variational Inference in MRFs

Almost all of the work in graphical models for game theory has mirrored ...
research
03/04/2015

Bethe Projections for Non-Local Inference

Many inference problems in structured prediction are naturally solved by...
research
11/06/2015

Barrier Frank-Wolfe for Marginal Inference

We introduce a globally-convergent algorithm for optimizing the tree-rew...

Please sign up or login with your details

Forgot password? Click here to reset