Deep Composition of Tensor Trains using Squared Inverse Rosenblatt Transports

07/14/2020
by   Tiangang Cui, et al.
0

Characterising intractable high-dimensional random variables is one of the fundamental challenges in stochastic computation. The recent surge of transport maps offers a mathematical foundation and new insights for tackling this challenge by coupling intractable random variables with tractable reference random variables. This paper generalises a recently developed functional tensor-train (FTT) approximation of the inverse Rosenblatt transport [14] to a wide class of high-dimensional nonnegative functions, such as unnormalised probability density functions. First, we extend the inverse Rosenblatt transform to enable the transport to general reference measures other than the uniform measure. We develop an efficient procedure to compute this transport from a squared FTT decomposition which preserves the monotonicity. More crucially, we integrate the proposed monotonicity-preserving FTT transport into a nested variable transformation framework inspired by deep neural networks. The resulting deep inverse Rosenblatt transport significantly expands the capability of tensor approximations and transport maps to random variables with complicated nonlinear interactions and concentrated density functions. We demonstrate the efficacy of the proposed approach on a range of applications in statistical learning and uncertainty quantification, including parameter estimation for dynamical systems and inverse problems constrained by partial differential equations.

READ FULL TEXT
06/08/2021

Conditional Deep Inverse Rosenblatt Transports

We present a novel offline-online method to mitigate the computational b...
09/05/2022

Deep importance sampling using tensor-trains with application to a priori and a posteriori rare event estimation

We propose a deep importance sampling method that is suitable for estima...
08/10/2020

Low-rank tensor reconstruction of concentrated densities with application to Bayesian inversion

Transport maps have become a popular mechanic to express complicated pro...
05/19/2022

Uncertainty Quantification for Transport in Porous media using Parameterized Physics Informed neural Networks

We present a Parametrization of the Physics Informed Neural Network (P-P...
08/29/2019

The network uncertainty quantification method for propagating uncertainties in component-based systems

This work introduces the network uncertainty quantification (NetUQ) meth...
03/17/2017

Inference via low-dimensional couplings

We investigate the low-dimensional structure of deterministic transforma...
11/09/2021

TTRISK: Tensor Train Decomposition Algorithm for Risk Averse Optimization

This article develops a new algorithm named TTRISK to solve high-dimensi...