Reduced Higher Order SVD: ubiquitous rank-reduction method in tensor-based scientific computing

by   Venera Khoromskaia, et al.

Tensor numerical methods, based on the rank-structured tensor representation of d-variate functions and operators, are designed to provide O(dn) complexity of numerical calculations on n^⊗ d grids contrary to O(n^d) scaling by conventional grid-based methods. However, multiple tensor operations may lead to enormous increase in the tensor ranks (curse of ranks) of the target data, making calculation intractable. Therefore one of the most important steps in tensor calculations is the robust and efficient rank reduction procedure which should be performed many times in the course of various tensor transforms in multidimensional operator and function calculus. The rank reduction scheme based on the Reduced Higher Order SVD (RHOSVD) introduced in [33] played a significant role in the development of tensor numerical methods. Here, we briefly survey the essentials of RHOSVD method and then focus on some new theoretical and computational aspects of the RHOSVD demonstrating that this rank reduction technique constitutes the basic ingredient in tensor computations for real-life problems. In particular, the stability analysis of RHOSVD is presented. We introduce the multilinear algebra of tensors represented in the range-separated (RS) tensor format. This allows to apply the RHOSVD rank-reduction techniques to non-regular functional data with many singularities, for example, to the rank-structured computation of the collective multi-particle interaction potentials in bio-molecular modeling, as well as to complicated composite radial functions. The new theoretical and numerical results on application of the RHOSVD in scattered data modeling are presented. RHOSVD proved to be the efficient rank reduction technique in numerous applications ranging from numerical treatment of multi-particle systems up to a numerical solution of PDE constrained control problems.


page 1

page 2

page 3

page 4


Prospects of tensor-based numerical modeling of the collective electrostatic potential in many-particle systems

Recently the rank-structured tensor approach suggested a progress in the...

Tensor Method for Optimal Control Problems Constrained by Fractional 3D Elliptic Operator with Variable Coefficients

We introduce the tensor numerical method for solving optimal control pro...

TLib: A Flexible C++ Tensor Framework for Numerical Tensor Calculus

Numerical tensor calculus comprise basic tensor operations such as the e...

Some Tucker-like approximations based on the modal semi-tensor product

Approximating higher-order tensors by the Tucker format has been applied...

Tensor rank reduction via coordinate flows

Recently, there has been a growing interest in efficient numerical algor...

Step-truncation integrators for evolution equations on low-rank tensor manifolds

We develop a new class of algorithms, which we call step-truncation meth...

Estimating Higher-Order Mixed Memberships via the ℓ_2,∞ Tensor Perturbation Bound

Higher-order multiway data is ubiquitous in machine learning and statist...

Please sign up or login with your details

Forgot password? Click here to reset