Renormalizing Diffusion Models

08/23/2023
by   Jordan Cotler, et al.
0

We explain how to use diffusion models to learn inverse renormalization group flows of statistical and quantum field theories. Diffusion models are a class of machine learning models which have been used to generate samples from complex distributions, such as the distribution of natural images, by learning the inverse process to a diffusion process which adds noise to the data until the distribution of the data is pure noise. Nonperturbative renormalization group schemes can naturally be written as diffusion processes in the space of fields. We combine these observations in a concrete framework for building ML-based models for studying field theories, in which the models learn the inverse process to an explicitly-specified renormalization group scheme. We detail how these models define a class of adaptive bridge (or parallel tempering) samplers for lattice field theory. Because renormalization group schemes have a physical meaning, we provide explicit prescriptions for how to compare results derived from models associated to several different renormalization group schemes of interest. We also explain how to use diffusion models in a variational method to find ground states of quantum systems. We apply some of our methods to numerically find RG flows of interacting statistical field theories. From the perspective of machine learning, our work provides an interpretation of multiscale diffusion models, and gives physically-inspired suggestions for diffusion models which should have novel properties.

READ FULL TEXT

page 7

page 9

page 37

research
01/20/2021

Introduction to Normalizing Flows for Lattice Field Theory

This notebook tutorial demonstrates a method for sampling Boltzmann dist...
research
10/21/2021

Quantum field theories, Markov random fields and machine learning

The transition to Euclidean space and the discretization of quantum fiel...
research
02/10/2021

Argmax Flows and Multinomial Diffusion: Towards Non-Autoregressive Language Models

The field of language modelling has been largely dominated by autoregres...
research
09/16/2021

Machine learning with quantum field theories

The precise equivalence between discretized Euclidean field theories and...
research
07/01/2022

Learning Lattice Quantum Field Theories with Equivariant Continuous Flows

We propose a novel machine learning method for sampling from the high-di...
research
03/14/2023

Generalised Scale-Space Properties for Probabilistic Diffusion Models

Probabilistic diffusion models enjoy increasing popularity in the deep l...
research
10/13/2021

Ordered conditional approximation of Potts models

Potts models, which can be used to analyze dependent observations on a l...

Please sign up or login with your details

Forgot password? Click here to reset