Tensor train construction from tensor actions, with application to compression of large high order derivative tensors

02/14/2020
by   Nick Alger, et al.
0

We present a method for converting tensors into tensor train format based on actions of the tensor as a vector-valued multilinear function. Existing methods for constructing tensor trains require access to "array entries" of the tensor and are therefore inefficient or computationally prohibitive if the tensor is accessible only through its action, especially for high order tensors. Our method permits efficient tensor train compression of large high order derivative tensors for nonlinear mappings that are implicitly defined through the solution of a system of equations. Array entries of these derivative tensors are not easily computable, but their actions can be computed efficiently via a procedure that we discuss. Such tensors are often amenable to tensor train compression in theory, but until now no practical algorithm existed to convert them into tensor train format. We demonstrate our method by compressing a Hilbert tensor of size 41 × 42 × 43 × 44 × 45, and by forming high order (up to 5^th order derivatives/6^th order tensors) Taylor series surrogates of the noise-whitened parameter-to-output map for a stochastic partial differential equation with boundary output.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2017

Completion of High Order Tensor Data with Missing Entries via Tensor-train Decomposition

In this paper, we aim at the completion problem of high order tensor dat...
research
07/21/2022

One-dimensional Tensor Network Recovery

We study the recovery of the underlying graphs or permutations for tenso...
research
05/12/2016

Exponential Machines

Modeling interactions between features improves the performance of machi...
research
10/12/2022

Optimizing Tensor Programs on Flexible Storage

Tensor programs often need to process large tensors (vectors, matrices, ...
research
09/25/2020

On the Compression of Translation Operator Tensors in FMM-FFT-Accelerated SIE Simulators via Tensor Decompositions

Tensor decomposition methodologies are proposed to reduce the memory req...
research
05/10/2020

AutoHOOT: Automatic High-Order Optimization for Tensors

High-order optimization methods, including Newton's method and its varia...
research
07/09/2022

Error Analysis of Tensor-Train Cross Approximation

Tensor train decomposition is widely used in machine learning and quantu...

Please sign up or login with your details

Forgot password? Click here to reset