A model sufficiency test using permutation entropy

12/16/2021
by   Xin Huang, et al.
0

Using the ordinal pattern concept in permutation entropy, we propose a model sufficiency test to study a given model's point prediction accuracy. Compared to some classical model sufficiency tests, such as the Broock et al.'s (1996) test, our proposal does not require a sufficient model to eliminate all structures exhibited in the estimated residuals. When the innovations in the investigated data's underlying dynamics show a certain structure, such as higher-moment serial dependence, the Broock et al.'s (1996) test can lead to erroneous conclusions about the sufficiency of point predictors. Due to the structured innovations, inconsistency between the model sufficiency tests and prediction accuracy criteria can occur. Our proposal fills in this incoherence between model and prediction evaluation approaches and remains valid when the underlying process has non-white additive innovation.

READ FULL TEXT

page 15

page 24

research
06/26/2021

Bahadur efficiencies of the Epps–Pulley test for normality

The test for normality suggested by Epps and Pulley (1983) is a serious ...
research
12/08/2015

Selective Sequential Model Selection

Many model selection algorithms produce a path of fits specifying a sequ...
research
05/22/2023

The NTK approximation is valid for longer than you think

We study when the neural tangent kernel (NTK) approximation is valid for...
research
12/08/2017

Detecting confounding due to subject identification in clinical machine learning diagnostic applications: a permutation test approach

Recently, Saeb et al (2017) showed that, in diagnostic machine learning ...
research
05/12/2023

Distribution free MMD tests for model selection with estimated parameters

Several kernel based testing procedures are proposed to solve the proble...
research
12/30/2022

Two new parameters for the ordinal analysis of images

Local patterns play an important role in statistical physics as well as ...
research
04/30/2018

Reflections on digital innovation

The paper by Henfridsson et al. opens up a new agenda for IS research on...

Please sign up or login with your details

Forgot password? Click here to reset