DeepAI AI Chat
Log In Sign Up

On Estimating Rank-One Spiked Tensors in the Presence of Heavy Tailed Errors

by   Arnab Auddy, et al.

In this paper, we study the estimation of a rank-one spiked tensor in the presence of heavy tailed noise. Our results highlight some of the fundamental similarities and differences in the tradeoff between statistical and computational efficiencies under heavy tailed and Gaussian noise. In particular, we show that, for p th order tensors, the tradeoff manifests in an identical fashion as the Gaussian case when the noise has finite 4(p-1) th moment. The difference in signal strength requirements, with or without computational constraints, for us to estimate the singular vectors at the optimal rate, interestingly, narrows for noise with heavier tails and vanishes when the noise only has finite fourth moment. Moreover, if the noise has less than fourth moment, tensor SVD, perhaps the most natural approach, is suboptimal even though it is computationally intractable. Our analysis exploits a close connection between estimating the rank-one spikes and the spectral norm of a random tensor with iid entries. In particular, we show that the order of the spectral norm of a random tensor can be precisely characterized by the moment of its entries, generalizing classical results for random matrices. In addition to the theoretical guarantees, we propose estimation procedures for the heavy tailed regime, which are easy to implement and efficient to run. Numerical experiments are presented to demonstrate their practical merits.


page 1

page 2

page 3

page 4


Two Results on Low-Rank Heavy-Tailed Multiresponse Regressions

This paper gives two theoretical results on estimating low-rank paramete...

Estimating Rank-One Spikes from Heavy-Tailed Noise via Self-Avoiding Walks

We study symmetric spiked matrix models with respect to a general class ...

Statistically Optimal and Computationally Efficient Low Rank Tensor Completion from Noisy Entries

In this article, we develop methods for estimating a low rank tensor fro...

Spectral algorithms for tensor completion

In the tensor completion problem, one seeks to estimate a low-rank tenso...

ICA based on Split Generalized Gaussian

Independent Component Analysis (ICA) - one of the basic tools in data an...

Robust Matrix Completion with Heavy-tailed Noise

This paper studies low-rank matrix completion in the presence of heavy-t...

Statistical analysis of latent generalized correlation matrix estimation in transelliptical distribution

Correlation matrices play a key role in many multivariate methods (e.g.,...