Automated extraction of mutual independence patterns using Bayesian comparison of partition models

01/15/2020
by   Guillaume Marrelec, et al.
28

Mutual independence is a key concept in statistics that characterizes the structural relationships between variables. Existing methods to investigate mutual independence rely on the definition of two competing models, one being nested into the other and used to generate a null distribution for a statistic of interest, usually under the asymptotic assumption of large sample size. As such, these methods have a very restricted scope of application. In the present manuscript, we propose to change the investigation of mutual independence from a hypothesis-driven task that can only be applied in very specific cases to a blind and automated search within patterns of mutual independence. To this end, we treat the issue as one of model comparison that we solve in a Bayesian framework. We show the relationship between such an approach and existing methods in the case of multivariate normal distributions as well as cross-classified multinomial distributions. We propose a general Markov chain Monte Carlo (MCMC) algorithm to numerically approximate the posterior distribution on the space of all patterns of mutual independence. The relevance of the method is demonstrated on synthetic data as well as two real datasets, showing the unique insight provided by this approach.

READ FULL TEXT

page 12

page 19

research
06/22/2023

Inferring the finest pattern of mutual independence from data

For a random variable X, we are interested in the blind extraction of it...
research
07/11/2022

Testing Independence of Bivariate Censored Data using Random Walk on Restricted Permutation Graph

In this paper, we propose a procedure to test the independence of bivari...
research
05/05/2021

A nonparametric test of independence based on L_1-error

We propose a test of mutual independence between random vectors with arb...
research
12/21/2018

Revisiting the Gelman-Rubin Diagnostic

Gelman and Rubin's (1992) convergence diagnostic is one of the most popu...
research
04/10/2020

On the identifiability of Bayesian factor analytic models

A well known identifiability issue in factor analytic models is the inva...
research
10/27/2021

Data-Driven Representations for Testing Independence: Modeling, Analysis and Connection with Mutual Information Estimation

This work addresses testing the independence of two continuous and finit...
research
04/04/2022

Testing for independence in high dimensions based on empirical copulas

Testing for pairwise independence for the case where the number of varia...

Please sign up or login with your details

Forgot password? Click here to reset