Statistical Properties of the Entropy from Ordinal Patterns

09/15/2022
by   Eduarda T. C. Chagas, et al.
0

The ultimate purpose of the statistical analysis of ordinal patterns is to characterize the distribution of the features they induce. In particular, knowing the joint distribution of the pair Entropy-Statistical Complexity for a large class of time series models would allow statistical tests that are unavailable to date. Working in this direction, we characterize the asymptotic distribution of the empirical Shannon's Entropy for any model under which the true normalized Entropy is neither zero nor one. We obtain the asymptotic distribution from the Central Limit Theorem (assuming large time series), the Multivariate Delta Method, and a third-order correction of its mean value. We discuss the applicability of other results (exact, first-, and second-order corrections) regarding their accuracy and numerical stability. Within a general framework for building test statistics about Shannon's Entropy, we present a bilateral test that verifies if there is enough evidence to reject the hypothesis that two signals produce ordinal patterns with the same Shannon's Entropy. We applied this bilateral test to the daily maximum temperature time series from three cities (Dublin, Edinburgh, and Miami) and obtained sensible results.

READ FULL TEXT

page 5

page 11

research
05/02/2022

Asymptotic Normality for Plug-in Estimators of Generalized Shannon's Entropy

Shannon's entropy is one of the building blocks of information theory an...
research
01/17/2018

Characterization of Time Series Via Rényi Complexity-Entropy Curves

One of the most useful tools for distinguishing between chaotic and stoc...
research
11/29/2022

Rao-Burbea centroids applied to the statistical characterisation of time series and images through ordinal patterns

Divergences or similarity measures between probability distributions hav...
research
12/30/2022

Two new parameters for the ordinal analysis of images

Local patterns play an important role in statistical physics as well as ...
research
04/13/2022

Time series features for supporting hydrometeorological explorations and predictions in ungauged locations using large datasets

Regression-based frameworks for streamflow regionalization are built aro...
research
09/23/2020

Estimating entropy rate from censored symbolic time series: a test for time-irreversibility

In this work we introduce a method for estimating entropy rate and entro...
research
05/27/2019

Ordinal Patterns in Long-Range Dependent Time Series

We analyze the ordinal structure of long-range dependent time series. To...

Please sign up or login with your details

Forgot password? Click here to reset