Unbiased Monte Carlo Cluster Updates with Autoregressive Neural Networks

05/12/2021
by   Dian Wu, et al.
13

Efficient sampling of complex high-dimensional probability densities is a central task in computational science. Machine Learning techniques based on autoregressive neural networks have been recently shown to provide good approximations of probability distributions of interest in physics. In this work, we propose a systematic way to remove the intrinsic bias associated with these variational approximations, combining it with Markov-chain Monte Carlo in an automatic scheme to efficiently generate cluster updates, which is particularly useful for models for which no efficient cluster update scheme is known. Our approach is based on symmetry-enforced cluster updates building on the neural-network representation of conditional probabilities. We demonstrate that such finite-cluster updates are crucial to circumvent ergodicity problems associated with global neural updates. We test our method for first- and second-order phase transitions in classical spin systems, proving in particular its viability for critical systems, or in the presence of metastable states.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/11/2019

Deep autoregressive models for the efficient variational simulation of many-body quantum systems

Artificial Neural Networks were recently shown to be an efficient repres...
research
08/09/2022

Sampling algorithms in statistical physics: a guide for statistics and machine learning

We discuss several algorithms for sampling from unnormalized probability...
research
01/20/2022

Metropolis Augmented Hamiltonian Monte Carlo

Hamiltonian Monte Carlo (HMC) is a powerful Markov Chain Monte Carlo (MC...
research
03/25/2022

Cluster Algebras: Network Science and Machine Learning

Cluster algebras have recently become an important player in mathematics...
research
03/21/2022

Hierarchical autoregressive neural networks for statistical systems

It was recently proposed that neural networks could be used to approxima...
research
08/27/2023

Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective

Recent years witnessed the development of powerful generative models bas...
research
01/31/2020

Non-reversibly updating a uniform [0,1] value for Metropolis accept/reject decisions

I show how it can be beneficial to express Metropolis accept/reject deci...

Please sign up or login with your details

Forgot password? Click here to reset