Bucket Renormalization for Approximate Inference

03/14/2018
by   Sungsoo Ahn, et al.
0

Probabilistic graphical models are a key tool in machine learning applications. Computing the partition function, i.e., normalizing constant, is a fundamental task of statistical inference but it is generally computationally intractable, leading to extensive study of approximation methods. Iterative variational methods are a popular and successful family of approaches. However, even state of the art variational methods can return poor results or fail to converge on difficult instances. In this paper, we instead consider computing the partition function via sequential summation over variables. We develop robust approximate algorithms by combining ideas from mini-bucket elimination with tensor network and renormalization group methods from statistical physics. The resulting "convergence-free" methods show good empirical performance on both synthetic and real-world benchmark models, even for difficult instances.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2017

Gauging Variational Inference

Computing partition function is the most important statistical inference...
research
01/05/2018

Gauged Mini-Bucket Elimination for Approximate Inference

Computing the partition function Z of a discrete graphical model is a fu...
research
05/24/2021

Partition Function Estimation: A Quantitative Study

Probabilistic graphical models have emerged as a powerful modeling tool ...
research
05/14/2019

Spectral Approximate Inference

Given a graphical model (GM), computing its partition function is the mo...
research
02/14/2012

Approximation by Quantization

Inference in graphical models consists of repeatedly multiplying and sum...
research
02/21/2018

VBALD - Variational Bayesian Approximation of Log Determinants

Evaluating the log determinant of a positive definite matrix is ubiquito...
research
04/13/2023

IBIA: An Incremental Build-Infer-Approximate Framework for Approximate Inference of Partition Function

Exact computation of the partition function is known to be intractable, ...

Please sign up or login with your details

Forgot password? Click here to reset