Information theory for non-stationary processes with stationary increments

12/06/2019
by   Carlos Granero-Belinchon, et al.
0

We describe how to analyze the wide class of non stationary processes with stationary centered increments using Shannon information theory. To do so, we use a practical viewpoint and define ersatz quantities from time-averaged probability distributions. These ersatz versions of entropy, mutual information and entropy rate can be estimated when only a single realization of the process is available. We abundantly illustrate our approach by analyzing Gaussian and non-Gaussian self-similar signals, as well as multi-fractal signals. Using Gaussian signals allow us to check that our approach is robust in the sense that all quantities behave as expected from analytical derivations. Using the stationarity (independence on the integration time) of the ersatz entropy rate, we show that this quantity is not only able to fine probe the self-similarity of the process but also offers a new way to quantify the multi-fractality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2018

Shannon and Rényi entropy rates of stationary vector valued Gaussian random processes

We derive expressions for the Shannon and Rényi entropy rates of station...
research
07/12/2017

Computing Entropies With Nested Sampling

The Shannon entropy, and related quantities such as mutual information, ...
research
07/15/2022

Renyi Entropy Rate of Stationary Ergodic Processes

In this paper, we examine the Renyi entropy rate of stationary ergodic p...
research
05/24/2021

NPD Entropy: A Non-Parametric Differential Entropy Rate Estimator

The estimation of entropy rates for stationary discrete-valued stochasti...
research
04/11/2019

Efficient Entropy Estimation for Stationary Time Series

Entropy estimation, due in part to its connection with mutual informatio...
research
11/21/2020

Monotonicity of the Trace-Inverse of Covariance Submatrices and Two-Sided Prediction

It is common to assess the "memory strength" of a stationary process loo...
research
06/18/2021

Stochastic Model-Based Left Ventricle Segmentation in 3D Echocardiography Using Fractional Brownian Motion

A novel approach for fully-automated segmentation of the left ventricle ...

Please sign up or login with your details

Forgot password? Click here to reset