Sparse Tensor Graphical Model: Non-convex Optimization and Statistical Inference

09/15/2016
by   Will Wei Sun, et al.
0

We consider the estimation and inference of sparse graphical models that characterize the dependency structure of high-dimensional tensor-valued data. To facilitate the estimation of the precision matrix corresponding to each way of the tensor, we assume the data follow a tensor normal distribution whose covariance has a Kronecker product structure. A critical challenge in the estimation and inference of this model is the fact that its penalized maximum likelihood estimation involves minimizing a non-convex objective function. To address it, this paper makes two contributions: (i) In spite of the non-convexity of this estimation problem, we prove that an alternating minimization algorithm, which iteratively estimates each sparse precision matrix while fixing the others, attains an estimator with the optimal statistical rate of convergence. Notably, such an estimator achieves estimation consistency with only one tensor sample, which was not observed in the previous work. (ii) We propose a de-biased statistical inference procedure for testing hypotheses on the true support of the sparse precision matrices, and employ it for testing a growing number of hypothesis with false discovery rate (FDR) control. The asymptotic normality of our test statistic and the consistency of FDR control procedure are established. Our theoretical results are further backed up by thorough numerical studies. We implement the methods into a publicly available R package Tlasso.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/06/2019

Convex and Non-convex Approaches for Statistical Inference with Noisy Labels

We study the problem of estimation and testing in logistic regression wi...
research
09/20/2017

Inter-Subject Analysis: Inferring Sparse Interactions with Dense Intra-Graphs

We develop a new modeling framework for Inter-Subject Analysis (ISA). Th...
research
12/31/2022

Confidence Sets under Generalized Self-Concordance

This paper revisits a fundamental problem in statistical inference from ...
research
05/26/2021

SG-PALM: a Fast Physically Interpretable Tensor Graphical Model

We propose a new graphical model inference procedure, called SG-PALM, fo...
research
02/11/2022

Inference and FDR Control for Simulated Ising Models in High-dimension

This paper studies the consistency and statistical inference of simulate...
research
05/06/2018

Bayesian Regularization for Graphical Models with Unequal Shrinkage

We consider a Bayesian framework for estimating a high-dimensional spars...
research
10/01/2018

Integrated Principal Components Analysis

Data integration, or the strategic analysis of multiple sources of data ...

Please sign up or login with your details

Forgot password? Click here to reset