The Mean-Field Approximation: Information Inequalities, Algorithms, and Complexity

02/16/2018
by   Vishesh Jain, et al.
0

The mean field approximation to the Ising model is a canonical variational tool that is used for analysis and inference in Ising models. We provide a simple and optimal bound for the KL error of the mean field approximation for Ising models on general graphs, and extend it to higher order Markov random fields. Our bound improves on previous bounds obtained in work in the graph limit literature by Borgs, Chayes, Lovász, Sós, and Vesztergombi and another recent work by Basak and Mukherjee. Our bound is tight up to lower order terms. Building on the methods used to prove the bound, along with techniques from combinatorics and optimization, we study the algorithmic problem of estimating the (variational) free energy for Ising models and general Markov random fields. For a graph G on n vertices and interaction matrix J with Frobenius norm J _F, we provide algorithms that approximate the free energy within an additive error of ϵ n J_F in time (poly(1/ϵ)). We also show that approximation within (n J_F)^1-δ is NP-hard for every δ > 0. Finally, we provide more efficient approximation algorithms, which find the optimal mean field approximation, for ferromagnetic Ising models and for Ising models satisfying Dobrushin's condition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/22/2018

Mean-field approximation, convex hierarchies, and the optimality of correlation rounding: a unified perspective

The free energy is a key quantity of interest in Ising models, but unfor...
research
02/16/2018

The Vertex Sample Complexity of Free Energy is Polynomial

We study the following question: given a massive Markov random field on ...
research
10/14/2022

Approximation Algorithms for Robot Tours in Random Fields with Guaranteed Estimation Accuracy

We study the sample placement and shortest tour problem for robots taske...
research
01/10/2013

A Factorized Variational Technique for Phase Unwrapping in Markov Random Fields

Some types of medical and topographic imaging device produce images in w...
research
11/23/2016

Multi-Modal Mean-Fields via Cardinality-Based Clamping

Mean Field inference is central to statistical physics. It has attracted...
research
12/31/2012

Bethe Bounds and Approximating the Global Optimum

Inference in general Markov random fields (MRFs) is NP-hard, though iden...
research
12/11/2020

Beyond Scaling: Calculable Error Bounds of the Power-of-Two-Choices Mean-Field Model in Heavy-Traffic

This paper provides a recipe for deriving calculable approximation error...

Please sign up or login with your details

Forgot password? Click here to reset