Information-Theoretic Limits for the Matrix Tensor Product

05/22/2020
by   Galen Reeves, et al.
0

This paper studies a high-dimensional inference problem involving the matrix tensor product of random matrices. This problem generalizes a number of contemporary data science problems including the spiked matrix models used in sparse principal component analysis and covariance estimation. It is shown that the information-theoretic limits can be described succinctly by formulas involving low-dimensional quantities. On the technical side, this paper introduces some new techniques for the analysis of high-dimensional matrix-valued signals. Specific contributions include a novel extension of the adaptive interpolation method that uses order-preserving positive semidefinite interpolation paths and a variance inequality based on continuous-time I-MMSE relations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2020

Information-theoretic limits of a multiview low-rank symmetric spiked matrix model

We consider a generalization of an important class of high-dimensional i...
research
08/08/2018

Some Statistical Problems with High Dimensional Financial data

For high dimensional data, some of the standard statistical techniques d...
research
07/16/2019

Exact Recovery of Tensor Robust Principal Component Analysis under Linear Transforms

This work studies the Tensor Robust Principal Component Analysis (TRPCA)...
research
06/01/2011

Sparse Non Gaussian Component Analysis by Semidefinite Programming

Sparse non-Gaussian component analysis (SNGCA) is an unsupervised method...
research
10/25/2019

Information Theoretic Limits for Phase Retrieval with Subsampled Haar Sensing Matrices

We study information theoretic limits of recovering an unknown n dimensi...
research
10/08/2019

An Information-theoretic Approach to Unsupervised Feature Selection for High-Dimensional Data

In this paper, we propose an information-theoretic approach to design th...
research
09/06/2020

Multilinear Common Component Analysis via Kronecker Product Representation

We consider the problem of extracting a common structure from multiple t...

Please sign up or login with your details

Forgot password? Click here to reset