Low-rank Tensor Train Decomposition Using TensorSketch

09/15/2023
by   Zhongming Chen, et al.
0

Tensor train decomposition is one of the most powerful approaches for processing high-dimensional data. For low-rank tensor train decomposition of large tensors, the alternating least squares (ALS) algorithm is widely used by updating each core tensor alternatively. However, it may suffer from the curse of dimensionality due to the large scale of subproblems. In this paper, a novel randomized proximal ALS algorithm is proposed for low-rank tensor train decomposition by using TensorSketch, which allows for efficient implementation via fast Fourier transform. The theoretical lower bounds of sketch size are estimated for approximating the optimal value of subproblems. Numerical experiments on synthetic and real-world data also demonstrate the effectiveness and efficiency of the proposed algorithm.

READ FULL TEXT

page 16

page 18

research
08/03/2023

A Randomized Block Krylov Method for Tensor Train Approximation

Tensor train decomposition is a powerful tool for dealing with high-dime...
research
01/27/2023

Practical Sketching Algorithms for Low-Rank Tucker Approximation of Large Tensors

Low-rank approximation of tensors has been widely used in high-dimension...
research
07/22/2021

Fast Low-Rank Tensor Decomposition by Ridge Leverage Score Sampling

Low-rank tensor decomposition generalizes low-rank matrix approximation ...
research
10/23/2018

Statistical mechanics of low-rank tensor decomposition

Often, large, high dimensional datasets collected across multiple modali...
research
09/03/2021

Large-Scale Learning with Fourier Features and Tensor Decompositions

Random Fourier features provide a way to tackle large-scale machine lear...
research
08/12/2020

Adaptive Tensor Learning with Tensor Networks

Tensor decomposition techniques have shown great successes in machine le...
research
08/07/2019

Faster Tensor Train Decomposition for Sparse Data

In recent years, the application of tensors has become more widespread i...

Please sign up or login with your details

Forgot password? Click here to reset