Normalizing Flows for Probabilistic Modeling and Inference

by   George Papamakarios, et al.

Normalizing flows provide a general mechanism for defining expressive probability distributions, only requiring the specification of a (usually simple) base distribution and a series of bijective transformations. There has been much recent work on normalizing flows, ranging from improving their expressive power to expanding their application. We believe the field has now matured and is in need of a unified perspective. In this review, we attempt to provide such a perspective by describing flows through the lens of probabilistic modeling and inference. We place special emphasis on the fundamental principles of flow design, and discuss foundational topics such as expressive power and computational trade-offs. We also broaden the conceptual framing of flows by relating them to more general probability transformations. Lastly, we summarize the use of flows for tasks such as generative modeling, approximate inference, and supervised learning.


page 1

page 2

page 3

page 4


The Expressive Power of a Class of Normalizing Flow Models

Normalizing flows have received a great deal of recent attention as they...

VFlow: More Expressive Generative Flows with Variational Data Augmentation

Generative flows are promising tractable models for density modeling tha...

Graphical Normalizing Flows

Normalizing flows model complex probability distributions by combining a...

Normalizing Flows on Tori and Spheres

Normalizing flows are a powerful tool for building expressive distributi...

A Probabilistic Forecast-Driven Strategy for a Risk-Aware Participation in the Capacity Firming Market

The core contribution is to propose a probabilistic forecast-driven stra...

Sinusoidal Flow: A Fast Invertible Autoregressive Flow

Normalising flows offer a flexible way of modelling continuous probabili...

Embedded-model flows: Combining the inductive biases of model-free deep learning and explicit probabilistic modeling

Normalizing flows have shown great success as general-purpose density es...

Code Repositories


Implementations of normalising flows using nflows

view repo


A continuation of stochastic-modeling, examining Normalizing Flows and probability density approximation

view repo


Normalizing flows in PyTorch

view repo