DeepAI AI Chat
Log In Sign Up

Pearson's goodness-of-fit tests for sparse distributions

12/06/2021
by   Shuhua Chang, et al.
Lakehead University
University of Minnesota
0

Pearson's chi-squared test is widely used to test the goodness of fit between categorical data and a given discrete distribution function. When the number of sets of the categorical data, say k, is a fixed integer, Pearson's chi-squared test statistic converges in distribution to a chi-squared distribution with k-1 degrees of freedom when the sample size n goes to infinity. In real applications, the number k often changes with n and may be even much larger than n. By using the martingale techniques, we prove that Pearson's chi-squared test statistic converges to the normal under quite general conditions. We also propose a new test statistic which is more powerful than chi-squared test statistic based on our simulation study. A real application to lottery data is provided to illustrate our methodology.

READ FULL TEXT

page 1

page 2

page 3

page 4

01/21/2022

Empirical likelihood method for complete independence test on high dimensional data

Given a random sample of size n from a p dimensional random vector, wher...
12/03/2019

Evidence for goodness of fit in Karl Pearson chi-squared statistics

Chi-squared tests for lack of fit are traditionally employed to find evi...
11/03/2021

A goodness-of-fit test based on a recursive product of spacings

We introduce a new statistical test based on the observed spacings of or...
12/23/2019

Study on upper limit of sample sizes for a two-level test in NIST SP800-22

NIST SP800-22 is one of the widely used statistical testing tools for ps...
11/24/2021

Asymptotics for Markov chain mixture detection

Sufficient conditions are provided under which the log-likelihood ratio ...
03/19/2021

The reference distributions of Maurer's universal statistical test and its improved tests

Maurer's universal statistical test can widely detect non-randomness of ...
06/10/2019

Degrees of Freedom Analysis of Unrolled Neural Networks

Unrolled neural networks emerged recently as an effective model for lear...