Predictive Information Rate in Discrete-time Gaussian Processes

06/01/2012
by   Samer A. Abdallah, et al.
0

We derive expressions for the predicitive information rate (PIR) for the class of autoregressive Gaussian processes AR(N), both in terms of the prediction coefficients and in terms of the power spectral density. The latter result suggests a duality between the PIR and the multi-information rate for processes with mutually inverse power spectra (i.e. with poles and zeros of the transfer function exchanged). We investigate the behaviour of the PIR in relation to the multi-information rate for some simple examples, which suggest, somewhat counter-intuitively, that the PIR is maximised for very `smooth' AR processes whose power spectra have multiple poles at zero frequency. We also obtain results for moving average Gaussian processes which are consistent with the duality conjectured earlier. One consequence of this is that the PIR is unbounded for MA(N) processes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2017

On the Information Dimension of Multivariate Gaussian Processes

The authors have recently defined the Rényi information dimension rate d...
research
04/27/2023

A Chain Rule for the Expected Suprema of Bernoulli Processes

We obtain an upper bound on the expected supremum of a Bernoulli process...
research
02/18/2021

Explicit Bivariate Rate Functions for Large Deviations in AR(1) and MA(1) Processes with Gaussian Innovations

We investigate large deviations properties for centered stationary AR(1)...
research
04/26/2016

Deep Multi-fidelity Gaussian Processes

We develop a novel multi-fidelity framework that goes far beyond the cla...
research
10/19/2020

Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems

Recent advances in Deep Gaussian Processes (DGPs) show the potential to ...
research
09/16/2019

Band-Limited Gaussian Processes: The Sinc Kernel

We propose a novel class of Gaussian processes (GPs) whose spectra have ...
research
12/12/2017

Approximation of Supremum of Max-Stable Stationary Processes and Pickands Constants

Let X(t),t∈R be a stochastically continuous stationary max-stable proces...

Please sign up or login with your details

Forgot password? Click here to reset