Physics Informed Convex Artificial Neural Networks (PICANNs) for Optimal Transport based Density Estimation

04/02/2021
by   Amanpreet Singh, et al.
15

Optimal Mass Transport (OMT) is a well studied problem with a variety of applications in a diverse set of fields ranging from Physics to Computer Vision and in particular Statistics and Data Science. Since the original formulation of Monge in 1781 significant theoretical progress been made on the existence, uniqueness and properties of the optimal transport maps. The actual numerical computation of the transport maps, particularly in high dimensions, remains a challenging problem. By Brenier's theorem, the continuous OMT problem can be reduced to that of solving a non-linear PDE of Monge-Ampere type whose solution is a convex function. In this paper, building on recent developments of input convex neural networks and physics informed neural networks for solving PDE's, we propose a Deep Learning approach to solve the continuous OMT problem. To demonstrate the versatility of our framework we focus on the ubiquitous density estimation and generative modeling tasks in statistics and machine learning. Finally as an example we show how our framework can be incorporated with an autoencoder to estimate an effective probabilistic generative model.

READ FULL TEXT

page 8

page 11

page 13

research
07/09/2023

A generative flow for conditional sampling via optimal transport

Sampling conditional distributions is a fundamental task for Bayesian in...
research
05/16/2022

A scalable deep learning approach for solving high-dimensional dynamic optimal transport

The dynamic formulation of optimal transport has attracted growing inter...
research
05/26/2021

Optimal Transport Based Refinement of Physics-Informed Neural Networks

In this paper, we propose a refinement strategy to the well-known Physic...
research
01/25/2018

A Distributed Framework for the Construction of Transport Maps

The need to reason about uncertainty in large, complex, and multi-modal ...
research
09/26/2018

Monge-Ampère Flow for Generative Modeling

We present a deep generative model, named Monge-Ampère flow, which build...
research
07/13/2023

Numerical Optimal Transport from 1D to 2D using a Non-local Monge-Ampère Equation

We consider the numerical solution of the optimal transport problem betw...
research
11/30/2022

Taming Hyperparameter Tuning in Continuous Normalizing Flows Using the JKO Scheme

A normalizing flow (NF) is a mapping that transforms a chosen probabilit...

Please sign up or login with your details

Forgot password? Click here to reset