Statistical tests based on Rényi entropy estimation

06/01/2021
by   Mehmet Siddik Cadirci, et al.
1

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability distribution. In this paper we propose goodness-of-fit statistics for the multivariate Student and multivariate Pearson type II distributions, based on the maximum entropy principle and a class of estimators for Rényi entropy based on nearest neighbour distances. We prove the L^2-consistency of these statistics using results on the subadditivity of Euclidean functionals on nearest neighbour graphs, and investigate their rate of convergence and asymptotic distribution using Monte Carlo methods. In addition we present a novel iterative method for estimating the shape parameter of the multivariate Student and multivariate Pearson type II distributions.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

10/21/2020

The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond

We introduce some new classes of unimodal rotational invariant direction...
10/13/2020

Entropy-based test for generalized Gaussian distributions

In this paper, we provide the proof of L^2 consistency for the kth neare...
04/04/2022

Estimating the Entropy of Linguistic Distributions

Shannon entropy is often a quantity of interest to linguists studying th...
01/13/2021

Multivariate phase-type theory for the site frequency spectrum

Linear functions of the site frequency spectrum (SFS) play a major role ...
11/08/2019

Estimating Normalizing Constants for Log-Concave Distributions: Algorithms and Lower Bounds

Estimating the normalizing constant of an unnormalized probability distr...
03/02/2022

A Unifying Framework for Some Directed Distances in Statistics

Density-based directed distances – particularly known as divergences – b...
09/23/2020

Estimating entropy rate from censored symbolic time series: a test for time-irreversibility

In this work we introduce a method for estimating entropy rate and entro...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.