Learning the temporal evolution of multivariate densities via normalizing flows

07/29/2021
by   Yubin Lu, et al.
5

In this work, we propose a method to learn probability distributions using sample path data from stochastic differential equations. Specifically, we consider temporally evolving probability distributions (e.g., those produced by integrating local or nonlocal Fokker-Planck equations). We analyze this evolution through machine learning assisted construction of a time-dependent mapping that takes a reference distribution (say, a Gaussian) to each and every instance of our evolving distribution. If the reference distribution is the initial condition of a Fokker-Planck equation, what we learn is the time-T map of the corresponding solution. Specifically, the learned map is a normalizing flow that deforms the support of the reference density to the support of each and every density snapshot in time. We demonstrate that this approach can learn solutions to non-local Fokker-Planck equations, such as those arising in systems driven by both Brownian and Lévy noise. We present examples with two- and three-dimensional, uni- and multimodal distributions to validate the method.

READ FULL TEXT

page 10

page 18

page 19

page 22

research
10/06/2021

Relative Entropy Gradient Sampler for Unnormalized Distributions

We propose a relative entropy gradient sampler (REGS) for sampling from ...
research
05/17/2021

Adaptive Density Tracking by Quadrature for Stochastic Differential Equations

Density tracking by quadrature (DTQ) is a numerical procedure for comput...
research
03/15/2023

Stochastic Interpolants: A Unifying Framework for Flows and Diffusions

We introduce a class of generative models based on the stochastic interp...
research
06/18/2021

Stochastic parareal: an application of probabilistic methods to time-parallelisation

Parareal is a well-studied algorithm for numerically integrating systems...
research
09/30/2022

Building Normalizing Flows with Stochastic Interpolants

A simple generative model based on a continuous-time normalizing flow be...
research
03/21/2020

Volumetric density-equalizing reference map with applications

The density-equalizing map, a technique developed for cartogram creation...
research
08/25/2023

Training normalizing flows with computationally intensive target probability distributions

Machine learning techniques, in particular the so-called normalizing flo...

Please sign up or login with your details

Forgot password? Click here to reset