Non parametric estimation of Joint entropy and Shannon mutual information, Asymptotic limits: Application to statistic tests
share
This paper proposes a new method for estimating the joint probability mass function of a pair of discrete random variables. This estimator is used to construct joint entropy and Shannon mutual information estimates of a pair of discrete random variables. Almost sure consistency and central limit Theorems are established. Theorical results are validated by simulations.
READ FULL TEXT