Deep Composition of Tensor Trains using Squared Inverse Rosenblatt Transports

by   Tiangang Cui, et al.

Characterising intractable high-dimensional random variables is one of the fundamental challenges in stochastic computation. The recent surge of transport maps offers a mathematical foundation and new insights for tackling this challenge by coupling intractable random variables with tractable reference random variables. This paper generalises a recently developed functional tensor-train (FTT) approximation of the inverse Rosenblatt transport [14] to a wide class of high-dimensional nonnegative functions, such as unnormalised probability density functions. First, we extend the inverse Rosenblatt transform to enable the transport to general reference measures other than the uniform measure. We develop an efficient procedure to compute this transport from a squared FTT decomposition which preserves the monotonicity. More crucially, we integrate the proposed monotonicity-preserving FTT transport into a nested variable transformation framework inspired by deep neural networks. The resulting deep inverse Rosenblatt transport significantly expands the capability of tensor approximations and transport maps to random variables with complicated nonlinear interactions and concentrated density functions. We demonstrate the efficacy of the proposed approach on a range of applications in statistical learning and uncertainty quantification, including parameter estimation for dynamical systems and inverse problems constrained by partial differential equations.


Conditional Deep Inverse Rosenblatt Transports

We present a novel offline-online method to mitigate the computational b...

Deep importance sampling using tensor-trains with application to a priori and a posteriori rare event estimation

We propose a deep importance sampling method that is suitable for estima...

Low-rank tensor reconstruction of concentrated densities with application to Bayesian inversion

Transport maps have become a popular mechanic to express complicated pro...

Uncertainty Quantification for Transport in Porous media using Parameterized Physics Informed neural Networks

We present a Parametrization of the Physics Informed Neural Network (P-P...

The network uncertainty quantification method for propagating uncertainties in component-based systems

This work introduces the network uncertainty quantification (NetUQ) meth...

Inference via low-dimensional couplings

We investigate the low-dimensional structure of deterministic transforma...

TTRISK: Tensor Train Decomposition Algorithm for Risk Averse Optimization

This article develops a new algorithm named TTRISK to solve high-dimensi...