Free Energy Evaluation Using Marginalized Annealed Importance Sampling

04/08/2022
by   Muneki Yasuda, et al.
0

The evaluation of the free energy of a stochastic model is considered to be a significant issue in various fields of physics and machine learning. However, the exact free energy evaluation is computationally infeasible because it includes an intractable partition function. Annealed importance sampling (AIS) is a type of importance sampling based on the Markov chain Monte Carlo method, which is similar to a simulated annealing, and can effectively approximate the free energy. This study proposes a new AIS-based approach, referred to as marginalized AIS (mAIS). The statistical efficiency of mAIS is investigated in detail based on a theoretical and numerical perspectives. Based on the investigation, it has been proved that mAIS is more effective than AIS under a certain condition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2020

Spatial Monte Carlo Integration with Annealed Importance Sampling

Evaluating expectations on a pairwise Boltzmann machine (PBM) (or Ising ...
research
07/23/2020

Efficient Evaluation of the Partition Function of RBMs with Annealed Importance Sampling

Probabilistic models based on Restricted Boltzmann Machines (RBMs) imply...
research
10/15/2016

Markov Chain Truncation for Doubly-Intractable Inference

Computing partition functions, the normalizing constants of probability ...
research
05/17/2023

Stein Π-Importance Sampling

Stein discrepancies have emerged as a powerful tool for retrospective im...
research
12/03/2015

Discrete Equilibrium Sampling with Arbitrary Nonequilibrium Processes

We present a novel framework for performing statistical sampling, expect...
research
05/30/2023

Non-convex Bayesian Learning via Stochastic Gradient Markov Chain Monte Carlo

The rise of artificial intelligence (AI) hinges on the efficient trainin...
research
03/26/2019

Comment on "Solving Statistical Mechanics Using VANs": Introducing saVANt - VANs Enhanced by Importance and MCMC Sampling

In this comment on "Solving Statistical Mechanics Using Variational Auto...

Please sign up or login with your details

Forgot password? Click here to reset