A Test for Independence Via Bayesian Nonparametric Estimation of Mutual Information

02/10/2020
by   Luai Al Labadi, et al.
0

Mutual information is a well-known tool to measure the mutual dependence between variables. In this paper, a Bayesian nonparametric estimation of mutual information is established by means of the Dirichlet process and the k-nearest neighbor distance. As a direct outcome of the estimation, an easy-to-implement test of independence is introduced through the relative belief ratio. Several theoretical properties of the approach are presented. The procedure is investigated through various examples where the results are compared to its frequentist counterpart and demonstrate a good performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/09/2021

A Bayesian Nonparametric Estimation of Mutual Information

Mutual information is a widely-used information theoretic measure to qua...
research
11/17/2017

Nonparametric independence testing via mutual information

We propose a test of independence of two multivariate random vectors, gi...
research
01/21/2015

A Bayesian alternative to mutual information for the hierarchical clustering of dependent random variables

The use of mutual information as a similarity measure in agglomerative h...
research
05/05/2021

A nonparametric test of independence based on L_1-error

We propose a test of mutual independence between random vectors with arb...
research
02/15/2018

"Dependency Bottleneck" in Auto-encoding Architectures: an Empirical Study

Recent works investigated the generalization properties in deep neural n...
research
10/27/2021

Data-Driven Representations for Testing Independence: Modeling, Analysis and Connection with Mutual Information Estimation

This work addresses testing the independence of two continuous and finit...
research
08/04/2018

Implementation and Analysis of Stable PUFs Using Gate Oxide Breakdown

We implement and analyze highly stable PUFs using two random gate oxide ...

Please sign up or login with your details

Forgot password? Click here to reset