On a conditional inequality in Kolmogorov complexity and its applications in communication complexity

05/01/2019
by   Andrei Romashchenko, et al.
0

Romashchenko and Zimand rom-zim:c:mutualinfo have shown that if we partition the set of pairs (x,y) of n-bit strings into combinatorial rectangles, then I(x:y) ≥ I(x:y | t(x,y)) - O( n), where I denotes mutual information in the Kolmogorov complexity sense, and t(x,y) is the rectangle containing (x,y). We observe that this inequality can be extended to coverings with rectangles which may overlap. The new inequality essentially states that in case of a covering with combinatorial rectangles, I(x:y) ≥ I(x:y | t(x,y)) - ρ - O( n), where t(x,y) is any rectangle containing (x,y) and ρ is the thickness of the covering, which is the maximum number of rectangles that overlap. We discuss applications to communication complexity of protocols that are nondeterministic, or randomized, or Arthur-Merlin, and also to the information complexity of interactive protocols.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/16/2017

An operational characterization of mutual information in algorithmic information theory

We show that the mutual information, in the sense of Kolmogorov complexi...
research
11/12/2021

A Reverse Jensen Inequality Result with Application to Mutual Information Estimation

The Jensen inequality is a widely used tool in a multitude of fields, su...
research
07/01/2019

Information Kernels

Given a set X of finite strings, one interesting question to ask is whet...
research
01/01/2019

Sharp Bounds for Mutual Covering

Verdú reformulated the covering problem in the non-asymptotic informatio...
research
08/24/2022

The Kolmogorov Birthday Paradox

We prove a Kolmogorov complexity variant of the birthday paradox. Suffic...
research
07/01/2023

On the Complexity of Robust Eventual Inequality Testing for C-Finite Functions

We study the computational complexity of a robust version of the problem...
research
01/02/2019

An Introductory Guide to Fano's Inequality with Applications in Statistical Estimation

Information theory plays an indispensable role in the development of alg...

Please sign up or login with your details

Forgot password? Click here to reset