Subspace power method for symmetric tensor decomposition and generalized PCA

12/09/2019
by   Joe Kileel, et al.
0

We introduce the Subspace Power Method (SPM) for decomposing symmetric even-order tensors. This algorithm relies on a power method iteration applied to a modified tensor, constructed from a matrix flattening. For tensors of rank up to roughly the square root of the number of tensor entries, we obtain provable guarantees for most steps of SPM, by drawing on results from algebraic geometry and dynamical systems. Numerical simulations indicate that SPM significantly outperforms state-of-the-art algorithms in terms of speed, while performing robustly for low-rank tensors subjected to additive noise. We also extend SPM to compute a certain generalized tensor decomposition, enabling generalized principal component analysis at extremely low SNR.

READ FULL TEXT
research
11/12/2021

Robust Eigenvectors of Symmetric Tensors

The tensor power method generalizes the matrix power method to higher or...
research
05/02/2018

Computing tensor Z-eigenvectors with dynamical systems

We present a new framework for computing Z-eigenvectors of general tenso...
research
10/29/2021

Landscape analysis of an improved power method for tensor decomposition

In this work, we consider the optimization formulation for symmetric ten...
research
03/03/2022

Real eigenstructure of regular simplex tensors

We are concerned with the eigenstructure of supersymmetric tensors. Like...
research
05/29/2017

Successive Rank-One Approximations for Nearly Orthogonally Decomposable Symmetric Tensors

Many idealized problems in signal processing, machine learning and stati...
research
06/18/2022

Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descent

An increasing number of data science and machine learning problems rely ...
research
06/25/2013

Fourier PCA and Robust Tensor Decomposition

Fourier PCA is Principal Component Analysis of a matrix obtained from hi...

Please sign up or login with your details

Forgot password? Click here to reset