Black box approximation in the tensor train format initialized by ANOVA decomposition

08/05/2022
by   Andrei Chertkov, et al.
0

Surrogate models can reduce computational costs for multivariable functions with an unknown internal structure (black boxes). In a discrete formulation, surrogate modeling is equivalent to restoring a multidimensional array (tensor) from a small part of its elements. The alternating least squares (ALS) algorithm in the tensor train (TT) format is a widely used approach to effectively solve this problem in the case of non-adaptive tensor recovery from a given training set (i.e., tensor completion problem). TT-ALS allows obtaining a low-parametric representation of the tensor, which is free from the curse of dimensionality and can be used for fast computation of the values at arbitrary tensor indices or efficient implementation of algebra operations with the black box (integration, etc.). However, to obtain high accuracy in the presence of restrictions on the size of the train data, a good choice of initial approximation is essential. In this work, we construct the ANOVA representation in the TT-format and use it as an initial approximation for the TT-ALS algorithm. The performed numerical computations for a number of multidimensional model problems, including the parametric partial differential equation, demonstrate a significant advantage of our approach for the commonly used random initial approximation. For all considered model problems we obtained an increase in accuracy by at least an order of magnitude with the same number of requests to the black box. The proposed approach is very general and can be applied in a wide class of real-world surrogate modeling and machine learning problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2021

Solution of the Fokker-Planck equation by cross approximation method in the tensor train format

We propose the novel numerical scheme for solution of the multidimension...
research
08/29/2019

Multi-resolution Low-rank Tensor Formats

We describe a simple, black-box compression format for tensors with a mu...
research
01/28/2023

PROTES: Probabilistic Optimization with Tensor Sampling

We develop new method PROTES for optimization of the multidimensional ar...
research
12/05/2017

Tensor Approximation of Advanced Metrics for Sensitivity Analysis

Following up on the success of the analysis of variance (ANOVA) decompos...
research
01/22/2021

Tensor-Train Networks for Learning Predictive Modeling of Multidimensional Data

Deep neural networks have attracted the attention of the machine learnin...
research
06/29/2021

Tensor-train approximation of the chemical master equation and its application for parameter inference

In this work, we perform Bayesian inference tasks for the chemical maste...
research
07/14/2020

Model-Agnostic Interpretable and Data-driven suRRogates suited for highly regulated industries

Highly regulated industries, like banking and insurance, ask for transpa...

Please sign up or login with your details

Forgot password? Click here to reset