DeepAI
Log In Sign Up

Graph quilting: graphical model selection from partially observed covariances

12/11/2019
by   Giuseppe Vinci, et al.
0

We investigate the problem of conditional dependence graph estimation when several pairs of nodes have no joint observation. For these pairs even the simplest metric of covariability, the sample covariance, is unavailable. This problem arises, for instance, in calcium imaging recordings where the activities of a large population of neurons are typically observed by recording from smaller subsets of cells at once, and several pairs of cells are never recorded simultaneously. With no additional assumption, the unavailability of parts of the covariance matrix translates into the unidentifiability of the precision matrix that, in the Gaussian graphical model setting, specifies the graph. Recovering a conditional dependence graph in such settings is fundamentally an extremely hard challenge, because it requires to infer conditional dependences between network nodes with no empirical evidence of their covariability. We call this challenge the "graph quilting problem". We demonstrate that, under mild conditions, it is possible to correctly identify not only the edges connecting the observed pairs of nodes, but also a superset of those connecting the variables that are never observed jointly. We propose an ℓ_1 regularized graph estimator based on a partially observed sample covariance matrix and establish its rates of convergence in high-dimensions. We finally present a simulation study and the analysis of calcium imaging data of ten thousand neurons in mouse visual cortex.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/17/2022

Low-Rank Covariance Completion for Graph Quilting with Applications to Functional Connectivity

As a tool for estimating networks in high dimensions, graphical models a...
04/04/2018

Active covariance estimation by random sub-sampling of variables

We study covariance matrix estimation for the case of partially observed...
10/13/2011

Efficient Latent Variable Graphical Model Selection via Split Bregman Method

We consider the problem of covariance matrix estimation in the presence ...
01/14/2019

Bayesian Graph Selection Consistency For Decomposable Graphs

Gaussian graphical models are a popular tool to learn the dependence str...
06/08/2020

Estimating High-dimensional Covariance and Precision Matrices under General Missing Dependence

A sample covariance matrix S of completely observed data is the key stat...
10/19/2012

Using the structure of d-connecting paths as a qualitative measure of the strength of dependence

Pearls concept OF a d - connecting path IS one OF the foundations OF the...
01/22/2022

Estimation of the covariance structure from SNP allele frequencies

We propose two new statistics, V and S, to disentangle the population hi...