Log In Sign Up

ISLET: Fast and Optimal Low-rank Tensor Regression via Importance Sketching

by   Anru Zhang, et al.

In this paper, we develop a novel procedure for low-rank tensor regression, namely Importance Sketching Low-rank Estimation for Tensors (ISLET). The central idea behind ISLET is importance sketching, i.e., carefully designed sketches based on both the responses and low-dimensional structure of the parameter of interest. We show that the proposed method is sharply minimax optimal in terms of the mean-squared error under low-rank Tucker assumptions and under randomized Gaussian ensemble design. In addition, if a tensor is low-rank with group sparsity, our procedure also achieves minimax optimality. Further, we show through numerical studies that ISLET achieves comparable or better mean-squared error performance to existing state-of-the-art methods whilst having substantial storage and run-time advantages including capabilities for parallel and distributed computing. In particular, our procedure performs reliable estimation with tensors of dimension p = O(10^8) and is 1 or 2 orders of magnitude faster than baseline methods.


Beyond Low Rank: A Data-Adaptive Tensor Completion Method

Low rank tensor representation underpins much of recent progress in tens...

Tensor denoising and completion based on ordinal observations

Higher-order tensors arise frequently in applications such as neuroimagi...

Robust low-rank tensor regression via truncation and adaptive Huber loss

This paper investigates robust low-rank tensor regression with only fini...

Cross: Efficient Low-rank Tensor Completion

The completion of tensors, or high-order arrays, attracts significant at...

Statistically Optimal and Computationally Efficient Low Rank Tensor Completion from Noisy Entries

In this article, we develop methods for estimating a low rank tensor fro...

Convex Tensor Decomposition via Structured Schatten Norm Regularization

We discuss structured Schatten norms for tensor decomposition that inclu...

Local Asymptotic Normality and Optimal Estimation of low-rank Quantum Systems

In classical statistics, a statistical experiment consisting of n i.i.d ...