Shannon and Rényi entropy rates of stationary vector valued Gaussian random processes

07/12/2018
by   Jaideep Mulherkar, et al.
0

We derive expressions for the Shannon and Rényi entropy rates of stationary vector valued Gaussian random processes using the block matrix version of Szegö's theorem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/06/2018

Statistical estimation of the Shannon entropy

The behavior of the Kozachenko - Leonenko estimates for the (differentia...
research
05/24/2021

NPD Entropy: A Non-Parametric Differential Entropy Rate Estimator

The estimation of entropy rates for stationary discrete-valued stochasti...
research
07/15/2022

Renyi Entropy Rate of Stationary Ergodic Processes

In this paper, we examine the Renyi entropy rate of stationary ergodic p...
research
12/06/2019

Information theory for non-stationary processes with stationary increments

We describe how to analyze the wide class of non stationary processes wi...
research
02/15/2010

Geometric approach to sampling and communication

Relationships that exist between the classical, Shannon-type, and geomet...
research
01/04/2021

The Gaussian entropy map in valued fields

We exhibit the analog of the entropy map for multivariate Gaussian distr...
research
09/05/2016

Reflections on Shannon Information: In search of a natural information-entropy for images

It is not obvious how to extend Shannon's original information entropy t...

Please sign up or login with your details

Forgot password? Click here to reset