Efficient construction of canonical polyadic approximations of tensor networks

08/22/2022
by   Karl Pierce, et al.
0

We consider the problem of constructing a canonical polyadic (CP) decomposition for a tensor network, rather than a single tensor. We illustrate how it is possible to reduce the complexity of constructing an approximate CP representation of the network by leveraging its structure in the course of the CP factor optimization. The utility of this technique is demonstrated for the order-4 Coulomb interaction tensor approximated by 2 order-3 tensors via an approximate generalized square-root (SQ) factorization, such as density fitting or (pivoted) Cholesky. The complexity of constructing a 4-way CP decomposition is reduced from 𝒪(n^4 R_CP) (for the non-approximated Coulomb tensor) to 𝒪(n^3 R_CP) for the SQ-factorized tensor, where n and R_CP are the basis and CP ranks, respectively. This reduces the cost of constructing the CP approximation of 2-body interaction tensors of relevance to accurate many-body electronic structure by up to 2 orders of magnitude for systems with up to 36 atoms studied here. The full 4-way CP approximation of the Coulomb interaction tensor is shown to be more accurate than the known approaches utilizing CP-decomposed SQ factors (also obtained at the 𝒪(n^3 R_CP) cost), such as the algebraic pseudospectral and tensor hypercontraction approaches. The CP decomposed SQ factors can also serve as a robust initial guess for the 4-way CP factors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/06/2020

Triple Decomposition and Tensor Recovery of Third Order Tensors

In this paper, we introduce a new tensor decomposition for third order t...
research
02/09/2018

Curve Registered Coupled Low Rank Factorization

We propose an extension of the canonical polyadic (CP) tensor model wher...
research
06/30/2020

Provable Online CP/PARAFAC Decomposition of a Structured Tensor via Dictionary Learning

We consider the problem of factorizing a structured 3-way tensor into it...
research
11/19/2020

CP-TT: using TT-SVD to greedily construct a Canonical Polyadic tensor approximation

In the present work, a method is proposed in order to compute a Canonica...
research
05/30/2023

Machine learning with tree tensor networks, CP rank constraints, and tensor dropout

Tensor networks approximate order-N tensors with a reduced number of deg...
research
01/08/2020

On Recoverability of Randomly Compressed Tensors with Low CP Rank

Our interest lies in the recoverability properties of compressed tensors...
research
10/08/2020

SWIFT: Scalable Wasserstein Factorization for Sparse Nonnegative Tensors

Existing tensor factorization methods assume that the input tensor follo...

Please sign up or login with your details

Forgot password? Click here to reset