Stationarity in the Realizations of the Causal Rate-Distortion Function for One-Sided Stationary Sources

04/11/2018
by   Milan S. Derpich, et al.
0

This paper derives novel results on the characterization of the the causal information rate-distortion function (IRDF) R_c^it(D) for arbitrarily-distributed one-sided stationary κ-th order Markov source x(1),x(2),.... It is first shown that Gorbunov and Pinsker's results on the stationarity of the realizations to the causal IRDF (stated for two-sided stationary sources) do not apply to the commonly used family of asymptotic average single-letter (AASL) distortion criteria. Moreover, we show that, in general, a reconstruction sequence cannot be both jointly stationary with a one-sided stationary source sequence and causally related to it. This implies that, in general, the causal IRDF for one-sided stationary sources cannot be realized by a stationary distribution. However, we prove that for an arbitrarily distributed one-sided stationary source and a large class of distortion criteria (including AASL), the search for R_c^it(D) can be restricted to distributions which yield the output sequence y(1), y(2),... jointly stationary with the source after κ samples. Finally, we improve the definition of the stationary causal IRDF R_c^it(D) previously introduced by Derpich and Østergaard for two-sided Markovian stationary sources and show that R_c^it(D) for a two-sided source ...,x(-1),x(0),x(1),... equals R_c^it(D) for the associated one-sided source x(1), x(2),.... This implies that, for the Gaussian quadratic case, the practical zero-delay encoder-decoder pairs proposed by Derpich and Østergaard for approaching R_c^it(D) achieve an operational data rate which exceeds R_c^it(D) by less than 1+0.5 _2(2 π e /12) ≃ 1.254 bits per sample.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/17/2020

Gauss-Markov Source Tracking with Side Information: Lower Bounds

We consider the problem of causal source coding and causal decoding of a...
research
11/21/2020

Monotonicity of the Trace-Inverse of Covariance Submatrices and Two-Sided Prediction

It is common to assess the "memory strength" of a stationary process loo...
research
12/19/2019

From the Bernoulli Factory to a Dice Enterprise via Perfect Sampling of Markov Chains

Given a p-coin that lands heads with unknown probability p, we wish to p...
research
11/05/2020

An Orthogonality Principle for Select-Maximum Estimation of Exponential Variables

It was recently proposed to encode the one-sided exponential source X in...
research
09/16/2018

The Structure of the Realizations of the Causal Information Rate-Distortion Function for Markovian Sources: Realizations with Densities

The main purpose of this note is to show that in a realization (x_1^n, y...
research
09/03/2019

Optimal Causal Rate-Constrained Sampling of the Wiener Process

We consider the following communication scenario. An encoder causally ob...
research
11/27/2020

Coded equivalence of one-sided topological Markov shifts

We introduce a notion of coded equivalence in one-sided topological Mark...

Please sign up or login with your details

Forgot password? Click here to reset