Localised Generative Flows

09/30/2019
by   Rob Cornish, et al.
7

We argue that flow-based density models based on continuous bijections are limited in their ability to learn target distributions with complicated topologies, and propose Localised Generative Flows (LGFs) to address this problem. LGFs are composed of stacked continuous mixtures of bijections, which enables each bijection to learn a local region of the target rather than its entirety. Our method is a generalisation of existing flow-based methods, which can be used without modification as the basis for an LGF model. Unlike normalising flows, LGFs do not permit exact computation of log likelihoods, but we propose a simple variational scheme that performs well in practice. We show empirically that LGFs yield improved performance across a variety of density estimation tasks.

READ FULL TEXT

page 2

page 3

page 14

page 15

page 16

page 17

page 18

research
06/05/2019

Cubic-Spline Flows

A normalizing flow models a complex probability density as an invertible...
research
06/09/2021

Tractable Density Estimation on Learned Manifolds with Conformal Embedding Flows

Normalizing flows are generative models that provide tractable density e...
research
04/23/2022

Graphical Residual Flows

Graphical flows add further structure to normalizing flows by encoding n...
research
08/29/2023

Mixed Variational Flows for Discrete Variables

Variational flows allow practitioners to learn complex continuous distri...
research
09/30/2022

Building Normalizing Flows with Stochastic Interpolants

A simple generative model based on a continuous-time normalizing flow be...
research
06/15/2021

Multi-Resolution Continuous Normalizing Flows

Recent work has shown that Neural Ordinary Differential Equations (ODEs)...
research
07/12/2023

Embracing the chaos: analysis and diagnosis of numerical instability in variational flows

In this paper, we investigate the impact of numerical instability on the...

Please sign up or login with your details

Forgot password? Click here to reset