Multi-level hypothesis testing for populations of heterogeneous networks

09/07/2018
by   Guilherme Gomes, et al.
18

In this work, we consider hypothesis testing and anomaly detection on datasets where each observation is a weighted network. Examples of such data include brain connectivity networks from fMRI flow data, or word co-occurrence counts for populations of individuals. Current approaches to hypothesis testing for weighted networks typically requires thresholding the edge-weights, to transform the data to binary networks. This results in a loss of information, and outcomes are sensitivity to choice of threshold levels. Our work avoids this, and we consider weighted-graph observations in two situations, 1) where each graph belongs to one of two populations, and 2) where entities belong to one of two populations, with each entity possessing multiple graphs (indexed e.g. by time). Specifically, we propose a hierarchical Bayesian hypothesis testing framework that models each population with a mixture of latent space models for weighted networks, and then tests populations of networks for differences in distribution over components. Our framework is capable of population-level, entity-specific, as well as edge-specific hypothesis testing. We apply it to synthetic data and three real-world datasets: two social media datasets involving word co-occurrences from discussions on Twitter of the political unrest in Brazil, and on Instagram concerning Attention Deficit Hyperactivity Disorder (ADHD) and depression drugs, and one medical dataset involving fMRI brain-scans of human subjects. The results show that our proposed method has lower Type I error and higher statistical power compared to alternatives that need to threshold the edge weights. Moreover, they show our proposed method is better suited to deal with highly heterogeneous datasets.

READ FULL TEXT

page 2

page 8

page 11

research
01/29/2021

A Practical Two-Sample Test for Weighted Random Graphs

Network (graph) data analysis is a popular research topic in statistics ...
research
11/24/2020

A spectral-based framework for hypothesis testing in populations of networks

In this paper, we propose a new spectral-based approach to hypothesis te...
research
08/18/2022

Lost in the Shuffle: Testing Power in the Presence of Errorful Network Vertex Labels

Many two-sample network hypothesis testing methodologies operate under t...
research
05/09/2021

Selective Probabilistic Classifier Based on Hypothesis Testing

In this paper, we propose a simple yet effective method to deal with the...
research
02/07/2020

Pairing for Generation of Synthetic Populations: the Direct Probabilistic Pairing method

Methods for the Generation of Synthetic Populations do generate the enti...
research
07/04/2017

Two-sample Hypothesis Testing for Inhomogeneous Random Graphs

The study of networks leads to a wide range of high dimensional inferenc...
research
06/20/2022

Multiple Testing Framework for Out-of-Distribution Detection

We study the problem of Out-of-Distribution (OOD) detection, that is, de...

Please sign up or login with your details

Forgot password? Click here to reset