More Efficient Sampling for Tensor Decomposition

10/14/2021
by   Osman Asif Malik, et al.
0

Recent papers have developed alternating least squares (ALS) methods for CP and tensor ring decomposition with a per-iteration cost which is sublinear in the number of input tensor entries for low-rank decomposition. However, the per-iteration cost of these methods still has an exponential dependence on the number of tensor modes. In this paper, we propose sampling-based ALS methods for the CP and tensor ring decompositions whose cost does not have this exponential dependence, thereby significantly improving on the previous state-of-the-art. We provide a detailed theoretical analysis and also apply the methods in a feature extraction experiment.

READ FULL TEXT

page 30

page 31

research
10/07/2022

Sampling-Based Decomposition Algorithms for Arbitrary Tensor Networks

We show how to develop sampling-based alternating least squares (ALS) al...
research
04/02/2021

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

Low-rank Tucker and CP tensor decompositions are powerful tools in data ...
research
07/15/2022

Low Rank Approximation for General Tensor Networks

We study the problem of approximating a given tensor with q modes A ∈ℝ^n...
research
05/28/2020

CPAC-Conv: CP-decomposition to Approximately Compress Convolutional Layers in Deep Learning

Feature extraction for tensor data serves as an important step in many t...
research
10/16/2020

A Sampling Based Method for Tensor Ring Decomposition

We propose a sampling based method for computing the tensor ring (TR) de...
research
04/11/2021

TedNet: A Pytorch Toolkit for Tensor Decomposition Networks

Tensor Decomposition Networks(TDNs) prevail for their inherent compact a...
research
05/02/2013

Tensor Decompositions: A New Concept in Brain Data Analysis?

Matrix factorizations and their extensions to tensor factorizations and ...

Please sign up or login with your details

Forgot password? Click here to reset