DeepAI AI Chat
Log In Sign Up

An Automated Theorem Proving Framework for Information-Theoretic Results

by   Cheuk Ting Li, et al.

We present a versatile automated theorem proving framework which is capable of automated proofs of outer bounds in network information theory, automated discovery of inner bounds in network information theory (in conjunction with the method by Lee and Chung), simplification of expressions and capacity regions, automated deduction of properties of information-theoretic quantities (e.g. Wyner and Gács-Körner common information), and automated discovery of non-Shannon-type inequalities, under a unified framework. Our method is based on the linear programming approach for proving Shannon-type information inequalities studied by Yeung and Zhang, together with a novel pruning method for searching auxiliary random variables. We also introduce the concept of existential information inequalities, which provides an axiomatic framework for a wide range of problems in information theory.


page 1

page 2

page 3

page 4


An Information-Theoretic Proof of the Kac–Bernstein Theorem

A short, information-theoretic proof of the Kac–Bernstein theorem, which...

The information-theoretic meaning of Gagliardo--Nirenberg type inequalities

Gagliardo--Nirenberg inequalities are interpolation inequalities which w...

On Characterization of Entropic Vectors at the Boundary of Almost Entropic Cones

The entropy region is a fundamental object in information theory. An out...

Proving Information Inequalities and Identities with Symbolic Computation

Proving linear inequalities and identities of Shannon's information meas...

A New Approach to Compute Information Theoretic Outer Bounds and Its Application to Regenerating Codes

The study of the fundamental limits of information systems is a central ...

On Data-Processing and Majorization Inequalities for f-Divergences with Applications

This paper is focused on derivations of data-processing and majorization...

Polarized Rewriting and Tableaux in B Set Theory

We propose and extension of the tableau-based first-order automated theo...