Tensorized Random Projections

03/11/2020
by   Beheshteh T. Rakhshan, et al.
0

We introduce a novel random projection technique for efficiently reducing the dimension of very high-dimensional tensors. Building upon classical results on Gaussian random projections and Johnson-Lindenstrauss transforms (JLT), we propose two tensorized random projection maps relying on the tensor train (TT) and CP decomposition format, respectively. The two maps offer very low memory requirements and can be applied efficiently when the inputs are low rank tensors given in the CP or TT format. Our theoretical analysis shows that the dense Gaussian matrix in JLT can be replaced by a low-rank tensor implicitly represented in compressed form with random factors, while still approximately preserving the Euclidean distance of the projected inputs. In addition, our results reveal that the TT format is substantially superior to CP in terms of the size of the random projection needed to achieve the same distortion ratio. Experiments on synthetic data validate our theoretical analysis and demonstrate the superiority of the TT decomposition.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

10/26/2021

Rademacher Random Projections with Tensor Networks

Random projection (RP) have recently emerged as popular techniques in th...
04/30/2021

Tensor Random Projection for Low Memory Dimension Reduction

Random projections reduce the dimension of a set of vectors while preser...
11/15/2016

Multilinear Low-Rank Tensors on Graphs & Applications

We propose a new framework for the analysis of low-rank tensors which li...
10/21/2020

Tensor Train Random Projection

This work proposes a novel tensor train random projection (TTRP) method ...
06/19/2018

Parallel Nonnegative CP Decomposition of Dense Tensors

The CP tensor decomposition is a low-rank approximation of a tensor. We ...
04/29/2014

Randomized Sketches of Convex Programs with Sharp Guarantees

Random projection (RP) is a classical technique for reducing storage and...
02/26/2021

TEC: Tensor Ensemble Classifier for Big Data

Tensor (multidimensional array) classification problem has become very p...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.