Second-Order Converses via Reverse Hypercontractivity

12/25/2018
by   Jingbo Liu, et al.
0

A strong converse shows that no procedure can beat the asymptotic (as blocklength n→∞) fundamental limit of a given information-theoretic problem for any fixed error probability. A second-order converse strengthens this conclusion by showing that the asymptotic fundamental limit cannot be exceeded by more than O(1√(n)). While strong converses are achieved in a broad range of information-theoretic problems by virtue of the `blowing-up method'---a powerful methodology due to Ahlswede, Gács and Körner (1976) based on concentration of measure---this method is fundamentally unable to attain second-order converses and is restricted to finite-alphabet settings. Capitalizing on reverse hypercontractivity of Markov semigroups and functional inequalities, this paper develops the `smothing-out' method, an alternative to the blowing-up approach that does not rely on finite alphabets and that leads to second-order converses in a variety of information-theoretic problems that were out of reach of previous methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2019

Generic Bounds on the Maximum Deviations in Sequential Prediction: An Information-Theoretic Analysis

In this paper, we derive generic bounds on the maximum deviations in pre...
research
08/08/2020

A simpler strong refutation of random k-XOR

Strong refutation of random CSPs is a fundamental question in theoretica...
research
05/10/2020

A Robust Matching Pursuit Algorithm Using Information Theoretic Learning

Current orthogonal matching pursuit (OMP) algorithms calculate the corre...
research
11/15/2016

Oracle Complexity of Second-Order Methods for Finite-Sum Problems

Finite-sum optimization problems are ubiquitous in machine learning, and...
research
12/09/2011

An Information Theoretic Analysis of Decision in Computer Chess

The basis of the method proposed in this article is the idea that inform...
research
04/08/2023

Non-asymptotic approximations of Gaussian neural networks via second-order Poincaré inequalities

There is a growing interest on large-width asymptotic properties of Gaus...
research
08/15/2019

Lifting countable to uncountable mathematics

Ordinary, i.e.non-set theoretic mathematics is generally formalised in s...

Please sign up or login with your details

Forgot password? Click here to reset