Mutual Information for Low-Rank Even-Order Symmetric Tensor Factorization

04/09/2019
by   Jean Barbier, et al.
0

We consider a statistical model for finite-rank symmetric tensor factorization and prove a single-letter variational expression for its mutual information when the tensor is of even order. The proof uses the adaptive interpolation method, for which rank-one matrix factorization is one of the first problem it was successfully applied to. We show how to extend the adaptive interpolation to finite-rank symmetric tensors of even order, which requires new ideas with respect to the proof for the rank-one case. We also underline where the proof falls short when dealing with odd-order tensors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/01/2018

On the tensor rank of 3× 3 permanent and determinant

The tensor rank and border rank of the 3 × 3 determinant tensor is known...
research
02/19/2019

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

We rigorously derive a single-letter variational expression for the mutu...
research
06/13/2018

Adaptive Path Interpolation for Sparse Systems: Application to a Simple Censored Block Model

A new adaptive path interpolation method has been recently developed as ...
research
05/16/2020

Information-theoretic limits of a multiview low-rank symmetric spiked matrix model

We consider a generalization of an important class of high-dimensional i...
research
12/30/2022

Gray–Wyner and Mutual Information Regions for Doubly Symmetric Binary Sources and Gaussian Sources

Nonconvex optimization plays a key role in multi-user information theory...
research
01/29/2015

Tensor Factorization via Matrix Factorization

Tensor factorization arises in many machine learning applications, such ...
research
04/12/2021

Statistical inference of finite-rank tensors

We consider a general statistical inference model of finite-rank tensor ...

Please sign up or login with your details

Forgot password? Click here to reset