A Development of Continuous-Time Transfer Entropy

05/15/2019
by   Joshua N. Cooper, et al.
0

Transfer entropy (TE) was introduced by Schreiber in 2000 as a measurement of the predictive capacity of one stochastic process with respect to another. Originally stated for discrete time processes, we expand the theory in line with recent work of Spinney, Prokopenko, and Lizier to define TE for stochastic processes indexed over a compact interval taking values in a Polish state space. We provide a definition for continuous time TE using the Radon-Nikodym Theorem, random measures, and projective limits of probability spaces. As our main result, we provide necessary and sufficient conditions to obtain this definition as a limit of discrete time TE, as well as illustrate its application via an example involving Poisson point processes. As a derivative of continuous time TE, we also define the transfer entropy rate between two processes and show that (under mild assumptions) their stationarity implies a constant rate. We also investigate TE between homogeneous Markov jump processes and discuss some open problems and possible future directions.

READ FULL TEXT
research
05/15/2019

Transfer Entropy in Continuous Time

Transfer entropy (TE) was introduced by Schreiber in 2000 as a measureme...
research
04/28/2021

Continuous-time locally stationary time series models

We adapt the classical definition of locally stationary processes in dis...
research
05/07/2020

Inference, Prediction, and Entropy-Rate Estimation of Continuous-time, Discrete-event Processes

Inferring models, predicting the future, and estimating the entropy rate...
research
02/19/2020

On the Trackability of Stochastic Processes

We consider the problem of estimating the state of a discrete stochastic...
research
12/09/2022

The entropy production of stationary diffusions

The entropy production rate is a central quantity in non-equilibrium sta...
research
07/08/2021

Compressibility Analysis of Asymptotically Mean Stationary Processes

This work provides new results for the analysis of random sequences in t...
research
04/09/2018

Characterising information-theoretic storage and transfer in continuous time processes

The characterisation of information processing is an important task in c...

Please sign up or login with your details

Forgot password? Click here to reset