A Permutation Test on Complex Sample Data

12/13/2017
by   Daniell Toth, et al.
0

Permutation tests are a distribution free way of performing hypothesis tests. These tests rely on the condition that the observed data are exchangeable among the groups being tested under the null hypothesis. This assumption is easily satisfied for data obtained from a simple random sample or a controlled study after simple adjustments to the data, but there is no general method for adjusting survey data collected using a complex sample design to allow for permutation tests. In this article, we propose a general method for performing a pseudo- permutation test that accounts for the complex sample design. The proposed method is not a true permutation test in that the new values do not come from the set of observed values in general, but of an expanded set of values satisfying a random-effects model on the clustered residuals. Tests using a simulated population comparing the performance of the proposed method to permutation tests that ignore the sample design demonstrate that it is necessary to account for certain design features in order to obtain reasonable p-value estimates.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/07/2020

Permutation Testing for Dependence in Time Series

Given observations from a stationary time series, permutation tests allo...
research
06/28/2018

Extremely efficient permutation and bootstrap hypothesis tests using R

Re-sampling based statistical tests are known to be computationally heav...
research
08/25/2023

Assessing Keyness using Permutation Tests

We propose a resampling-based approach for assessing keyness in corpus l...
research
05/04/2023

Credibility of high R^2 in regression problems: a permutation approach

The question of whether Y can be predicted based on X often arises and w...
research
04/28/2020

Permutation tests under a rotating sampling plan with clustered data

Consider a population consisting of clusters of sampling units, evolving...
research
04/15/2021

Logical contradictions in the One-way ANOVA and Tukey-Kramer multiple comparisons tests with more than two groups of observations

We show that the One-way ANOVA and Tukey-Kramer (TK) tests agree on any ...
research
02/02/2022

Faster Exact Permutation Testing: Using a Representative Subgroup

Non-parametric tests based on permutation, rotation or sign-flipping are...

Please sign up or login with your details

Forgot password? Click here to reset