Two-sample inference for high-dimensional Markov networks

05/01/2019
by   Byol Kim, et al.
0

Markov networks are frequently used in sciences to represent conditional independence relationships underlying observed variables arising from a complex system. It is often of interest to understand how an underlying network differs between two conditions. In this paper, we develop methodology for performing valid statistical inference for difference between parameters of Markov network in a high-dimensional setting where the number of observed variables is allowed to be larger than the sample size. Our proposal is based on the regularized Kullback-Leibler Importance Estimation Procedure that allows us to directly learn the parameters of the differential network, without requiring for separate or joint estimation of the individual Markov network parameters. This allows for applications in cases where individual networks are not sparse, such as networks that contain hub nodes, but the differential network is sparse. We prove that our estimator is regular and its distribution can be well approximated by a normal under wide range of data generating processes and, in particular, is not sensitive to model selection mistakes. Furthermore, we develop a new testing procedure for equality of Markov networks, which is based on a max-type statistics. A valid bootstrap procedure is developed that approximates quantiles of the test statistics. The performance of the methodology is illustrated through extensive simulations and real data examples.

READ FULL TEXT

page 27

page 28

page 29

page 30

research
02/18/2020

Post-selection inference on high-dimensional varying-coefficient quantile regression model

Quantile regression has been successfully used to study heterogeneous an...
research
07/30/2020

Impulse Response Analysis for Sparse High-Dimensional Time Series

We consider structural impulse response analysis for sparse high-dimensi...
research
09/17/2020

Statistical Inference for High-Dimensional Vector Autoregression with Measurement Error

High-dimensional vector autoregression with measurement error is frequen...
research
09/13/2016

Learning conditional independence structure for high-dimensional uncorrelated vector processes

We formulate and analyze a graphical model selection method for inferrin...
research
07/15/2020

Statistical Inference for Networks of High-Dimensional Point Processes

Fueled in part by recent applications in neuroscience, the multivariate ...
research
01/06/2017

Learning Sparse Structural Changes in High-dimensional Markov Networks: A Review on Methodologies and Theories

Recent years have seen an increasing popularity of learning the sparse c...
research
07/02/2014

Support Consistency of Direct Sparse-Change Learning in Markov Networks

We study the problem of learning sparse structure changes between two Ma...

Please sign up or login with your details

Forgot password? Click here to reset