Simultaneous Inference for Pairwise Graphical Models with Generalized Score Matching

05/15/2019
by   Ming Yu, et al.
0

Probabilistic graphical models provide a flexible yet parsimonious framework for modeling dependencies among nodes in networks. There is a vast literature on parameter estimation and consistent model selection for graphical models. However, in many of the applications, scientists are also interested in quantifying the uncertainty associated with the estimated parameters and selected models, which current literature has not addressed thoroughly. In this paper, we propose a novel estimator for statistical inference on edge parameters in pairwise graphical models based on generalized Hyvärinen scoring rule. Hyvärinen scoring rule is especially useful in cases where the normalizing constant cannot be obtained efficiently in a closed form, which is a common problem for graphical models, including Ising models and truncated Gaussian graphical models. Our estimator allows us to perform statistical inference for general graphical models whereas the existing works mostly focus on statistical inference for Gaussian graphical models where finding normalizing constant is computationally tractable. Under mild conditions that are typically assumed in the literature for consistent estimation, we prove that our proposed estimator is √(n)-consistent and asymptotically normal, which allows us to construct confidence intervals and build hypothesis tests for edge parameters. Moreover, we show how our proposed method can be applied to test hypotheses that involve a large number of model parameters simultaneously. We illustrate validity of our estimator through extensive simulation studies on a diverse collection of data-generating processes.

READ FULL TEXT
research
02/27/2014

Addendum on the scoring of Gaussian directed acyclic graphical models

We provide a correction to the expression for scoring Gaussian directed ...
research
09/15/2018

Learning high-dimensional graphical models with regularized quadratic scoring

Pairwise Markov Random Fields (MRFs) or undirected graphical models are ...
research
12/02/2021

Optimal regularizations for data generation with probabilistic graphical models

Understanding the role of regularization is a central question in Statis...
research
03/09/2018

Joint Estimation and Inference for Data Integration Problems based on Multiple Multi-layered Gaussian Graphical Models

The rapid development of high-throughput technologies has enabled the ge...
research
10/20/2022

Graphical Model Inference with Erosely Measured Data

In this paper, we investigate the Gaussian graphical model inference pro...
research
12/30/2014

On Semiparametric Exponential Family Graphical Models

We propose a new class of semiparametric exponential family graphical mo...
research
02/18/2018

Graphical Models for Non-Negative Data Using Generalized Score Matching

A common challenge in estimating parameters of probability density funct...

Please sign up or login with your details

Forgot password? Click here to reset