Doeblin Coefficients and Related Measures

09/15/2023
by   Anuran Makur, et al.
0

Doeblin coefficients are a classical tool for analyzing the ergodicity and exponential convergence rates of Markov chains. Propelled by recent works on contraction coefficients of strong data processing inequalities, we investigate whether Doeblin coefficients also exhibit some of the notable properties of canonical contraction coefficients. In this paper, we present several new structural and geometric properties of Doeblin coefficients. Specifically, we show that Doeblin coefficients form a multi-way divergence, exhibit tensorization, and possess an extremal trace characterization. We then show that they also have extremal coupling and simultaneously maximal coupling characterizations. By leveraging these characterizations, we demonstrate that Doeblin coefficients act as a nice generalization of the well-known total variation (TV) distance to a multi-way divergence, enabling us to measure the "distance" between multiple distributions rather than just two. We then prove that Doeblin coefficients exhibit contraction properties over Bayesian networks similar to other canonical contraction coefficients. We additionally derive some other results and discuss an application of Doeblin coefficients to distribution fusion. Finally, in a complementary vein, we introduce and discuss three new quantities: max-Doeblin coefficient, max-DeGroot distance, and min-DeGroot distance. The max-Doeblin coefficient shares a connection with the concept of maximal leakage in information security; we explore its properties and provide a coupling characterization. On the other hand, the max-DeGroot and min-DeGroot measures extend the concept of DeGroot distance to multiple distributions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/17/2020

Privacy Amplification of Iterative Algorithms via Contraction Coefficients

We investigate the framework of privacy amplification by iteration, rece...
research
12/20/2020

Privacy Analysis of Online Learning Algorithms via Contraction Coefficients

We propose an information-theoretic technique for analyzing privacy guar...
research
11/11/2020

On contraction coefficients, partial orders and approximation of capacities for quantum channels

The data processing inequality is the most basic requirement for any mea...
research
04/23/2020

On Relations Between the Relative entropy and χ^2–Divergence, Generalizations and Applications

This paper is focused on a study of integral relations between the relat...
research
12/19/2017

Asymptotic Coupling and Its Applications in Information Theory

A coupling of two distributions P_X and P_Y is a joint distribution P_XY...
research
06/07/2022

On Binomial coefficients of real arguments

As is well-known, a generalization of the classical concept of the facto...
research
02/12/2022

A Variational Formula for Infinity-Rényi Divergence with Applications to Information Leakage

We present a variational characterization for the Rényi divergence of or...

Please sign up or login with your details

Forgot password? Click here to reset