A theory of continuous generative flow networks

01/30/2023
by   Salem Lahlou, et al.
0

Generative flow networks (GFlowNets) are amortized variational inference algorithms that are trained to sample from unnormalized target distributions over compositional objects. A key limitation of GFlowNets until this time has been that they are restricted to discrete spaces. We present a theory for generalized GFlowNets, which encompasses both existing discrete GFlowNets and ones with continuous or hybrid state spaces, and perform experiments with two goals in mind. First, we illustrate critical points of the theory and the importance of various assumptions. Second, we empirically demonstrate how observations about discrete GFlowNets transfer to the continuous case and show strong results compared to non-GFlowNet baselines on several previously studied tasks. This work greatly widens the perspectives for the application of GFlowNets in probabilistic inference and various modeling settings.

READ FULL TEXT

page 8

page 20

research
10/02/2022

GFlowNets and variational inference

This paper builds bridges between two families of probabilistic algorith...
research
02/03/2022

Generative Flow Networks for Discrete Probabilistic Modeling

We present energy-based generative flow networks (EB-GFN), a novel proba...
research
06/28/2019

The Thermodynamic Variational Objective

We introduce the thermodynamic variational objective (TVO) for learning ...
research
08/29/2023

Mixed Variational Flows for Discrete Variables

Variational flows allow practitioners to learn complex continuous distri...
research
01/08/2020

Lifted Hybrid Variational Inference

A variety of lifted inference algorithms, which exploit model symmetry t...
research
01/14/2020

Critical Sets of PL and Discrete Morse Theory: a Correspondence

Piecewise-linear (PL) Morse theory and discrete Morse theory are used in...
research
09/16/2022

Optimal Scaling for Locally Balanced Proposals in Discrete Spaces

Optimal scaling has been well studied for Metropolis-Hastings (M-H) algo...

Please sign up or login with your details

Forgot password? Click here to reset