Sampling-Based Decomposition Algorithms for Arbitrary Tensor Networks

10/07/2022
by   Osman Asif Malik, et al.
0

We show how to develop sampling-based alternating least squares (ALS) algorithms for decomposition of tensors into any tensor network (TN) format. Provided the TN format satisfies certain mild assumptions, resulting algorithms will have input sublinear per-iteration cost. Unlike most previous works on sampling-based ALS methods for tensor decomposition, the sampling in our framework is done according to the exact leverage score distribution of the design matrices in the ALS subproblems. We implement and test two tensor decomposition algorithms that use our sampling framework in a feature extraction experiment where we compare them against a number of other decomposition algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/14/2021

More Efficient Sampling for Tensor Decomposition

Recent papers have developed alternating least squares (ALS) methods for...
research
11/19/2021

Parallel algorithms for computing the tensor-train decomposition

The tensor-train (TT) decomposition expresses a tensor in a data-sparse ...
research
11/02/2018

Spectral Methods from Tensor Networks

A tensor network is a diagram that specifies a way to "multiply" a colle...
research
10/16/2020

A Sampling Based Method for Tensor Ring Decomposition

We propose a sampling based method for computing the tensor ring (TR) de...
research
06/27/2023

Tensor Completion via Leverage Sampling and Tensor QR Decomposition for Network Latency Estimation

In this paper, we consider the network latency estimation, which has bee...
research
01/29/2023

Fast Exact Leverage Score Sampling from Khatri-Rao Products with Applications to Tensor Decomposition

We present a data structure to randomly sample rows from the Khatri-Rao ...
research
06/01/2020

Streaming Coresets for Symmetric Tensor Factorization

Factorizing tensors has recently become an important optimization module...

Please sign up or login with your details

Forgot password? Click here to reset