On a waiting-time result of Kontoyiannis: mixing or decoupling?

09/20/2022
by   Giampaolo Cristadoro, et al.
0

We introduce conditions of lower decoupling to the study of waiting-time estimations of the cross entropy between two mutually independent stationary stochastic processes. Although similar decoupling conditions have been used in the literature on large deviations and statistical mechanics, they appear largely unexplored in information theory. Building on a result of Kontoyiannis, namely Theorem 4 in [Kontoyiannis, J. Theor. Probab., 1998], and replacing the ψ-mixing condition in this result with a lower decoupling condition, we considerably extend the validity of waiting-time estimation of cross entropy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/15/2022

Rényi Cross-Entropy Measures for Common Distributions and Processes with Memory

Two Rényi-type generalizations of the Shannon cross-entropy, the Rényi c...
research
09/20/2022

Recurrence times, waiting times and universal entropy production estimators

The universal typical-signal estimators of entropy and cross entropy bas...
research
11/14/2018

The case for shifting the Renyi Entropy

We introduce a variant of the Rényi entropy definition that aligns it wi...
research
11/27/2020

Statistical theory for image classification using deep convolutional neural networks with cross-entropy loss

Convolutional neural networks learned by minimizing the cross-entropy lo...
research
03/09/2020

Strong mixing condition for Hawkes processes and application to Whittle estimation from count data

This paper focuses on the time series generated by the event counts of s...
research
10/15/2022

Encoding subshifts through sliding block codes

We prove a generalization of Krieger's embedding theorem, in the spirit ...
research
11/15/2021

Joint FCLT for the Sample Quantile and Measures of Dispersion for Functionals of Mixing Processes

In this paper, we establish a joint (bivariate) functional central limit...

Please sign up or login with your details

Forgot password? Click here to reset