Communication-efficient Distributed Estimation and Inference for Transelliptical Graphical Models

12/29/2016
by   Pan Xu, et al.
0

We propose communication-efficient distributed estimation and inference methods for the transelliptical graphical model, a semiparametric extension of the elliptical distribution in the high dimensional regime. In detail, the proposed method distributes the d-dimensional data of size N generated from a transelliptical graphical model into m worker machines, and estimates the latent precision matrix on each worker machine based on the data of size n=N/m. It then debiases the local estimators on the worker machines and send them back to the master machine. Finally, on the master machine, it aggregates the debiased local estimators by averaging and hard thresholding. We show that the aggregated estimator attains the same statistical rate as the centralized estimator based on all the data, provided that the number of machines satisfies m ≲{N d/d,√(N/(s^2 d))}, where s is the maximum number of nonzero entries in each column of the latent precision matrix. It is worth noting that our algorithm and theory can be directly applied to Gaussian graphical models, Gaussian copula graphical models and elliptical graphical models, since they are all special cases of transelliptical graphical models. Thorough experiments on synthetic data back up our theory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2016

Communication-efficient Distributed Sparse Linear Discriminant Analysis

We propose a communication-efficient distributed estimation method for s...
research
09/21/2018

Learning of Tree-Structured Gaussian Graphical Models on Distributed Data under Communication Constraints

In this paper, learning of tree-structured Gaussian graphical models fro...
research
12/28/2015

Post-Regularization Inference for Dynamic Nonparanormal Graphical Models

We propose a novel class of dynamic nonparanormal graphical models, whic...
research
10/05/2017

Learning Graphical Models from a Distributed Stream

A current challenge for data management systems is to support the constr...
research
03/19/2013

Marginal Likelihoods for Distributed Parameter Estimation of Gaussian Graphical Models

We consider distributed estimation of the inverse covariance matrix, als...
research
06/06/2019

Learning Gaussian Graphical Models with Ordered Weighted L1 Regularization

We address the task of identifying densely connected subsets of multivar...
research
07/29/2009

Collaborative Training in Sensor Networks: A graphical model approach

Graphical models have been widely applied in solving distributed inferen...

Please sign up or login with your details

Forgot password? Click here to reset