A Bayesian Nonparametric Estimation of Mutual Information

08/09/2021
by   Luai Al Labadi, et al.
0

Mutual information is a widely-used information theoretic measure to quantify the amount of association between variables. It is used extensively in many applications such as image registration, diagnosis of failures in electrical machines, pattern recognition, data mining and tests of independence. The main goal of this paper is to provide an efficient estimator of the mutual information based on the approach of Al Labadi et. al. (2021). The estimator is explored through various examples and is compared to its frequentist counterpart due to Berrett et al. (2019). The results show the good performance of the procedure by having a smaller mean squared error.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2020

A Test for Independence Via Bayesian Nonparametric Estimation of Mutual Information

Mutual information is a well-known tool to measure the mutual dependence...
research
09/08/2021

A Bayesian Framework for Information-Theoretic Probing

Pimentel et al. (2020) recently analysed probing from an information-the...
research
01/31/2013

Equitability, mutual information, and the maximal information coefficient

Reshef et al. recently proposed a new statistical measure, the "maximal ...
research
08/05/2022

Kendall's tau estimator for bivariate zero-inflated count data

In this paper, we extend the work of Pimentel et al. (2015) and propose ...
research
12/11/2019

Discriminative Dimension Reduction based on Mutual Information

The "curse of dimensionality" is a well-known problem in pattern recogni...
research
05/08/2019

Data-Efficient Mutual Information Neural Estimator

Measuring Mutual Information (MI) between high-dimensional, continuous, ...
research
06/23/2020

Distance Correlation Sure Independence Screening for Accelerated Feature Selection in Parkinson's Disease Vocal Data

With the abundance of machine learning methods available and the temptat...

Please sign up or login with your details

Forgot password? Click here to reset