Inequalities for space-bounded Kolmogorov complexity

10/20/2020
by   Péter Gács, et al.
0

There is a parallelism between Shannon information theory and algorithmic information theory. In particular, the same linear inequalities are true for Shannon entropies of tuples of random variables and Kolmogorov complexities of tuples of strings (Hammer et al., 1997), as well as for sizes of subgroups and projections of sets (Chan, Yeung, Romashchenko, Shen, Vereshchagin, 1998–2002). This parallelism started with the Kolmogorov-Levin formula (1968) for the complexity of pairs of strings with logarithmic precision. Longpré (1986) proved a version of this formula for space-bounded complexities. In this paper we prove an improved version of Longpré's result with a tighter space bound, using Sipser's trick (1980). Then, using this space bound, we show that every linear inequality that is true for complexities or entropies, is also true for space-bounded Kolmogorov complexities with a polynomial space overhead.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2022

Inequalities for entropies and dimensions

We show that linear inequalities for entropies have a natural geometric ...
research
01/22/2019

How to Use Undiscovered Information Inequalities: Direct Applications of the Copy Lemma

We discuss linear programming techniques that help to deduce corollaries...
research
04/28/2022

Information Inequalities via Submodularity and a Problem in Extremal Graph Theory

The present paper offers, in its first part, a unified approach for the ...
research
02/18/2022

Information Decomposition Diagrams Applied beyond Shannon Entropy: A Generalization of Hu's Theorem

In information theory, one major goal is to find useful functions that s...
research
09/21/2023

Information inequality problem over set functions

Information inequalities appear in many database applications such as qu...
research
08/30/2020

Precise Expression for the Algorithmic Information Distance

We consider the notion of information distance between two objects x and...
research
11/26/2014

Localized Complexities for Transductive Learning

We show two novel concentration inequalities for suprema of empirical pr...

Please sign up or login with your details

Forgot password? Click here to reset