Information-Theoretic Foundations of Mismatched Decoding

03/26/2020
by   Jonathan Scarlett, et al.
0

Shannon's channel coding theorem characterizes the maximal rate of information that can be reliably transmitted over a communication channel when optimal encoding and decoding strategies are used. In many scenarios, however, practical considerations such as channel uncertainty and implementation constraints rule out the use of an optimal decoder. The mismatched decoding problem addresses such scenarios by considering the case that the decoder cannot be optimized, but is instead fixed as part of the problem statement. This problem is not only of direct interest in its own right, but also has close connections with other long-standing theoretical problems in information theory. In this monograph, we survey both classical literature and recent developments on the mismatched decoding problem, with an emphasis on achievable random-coding rates for memoryless channels. We present two widely-considered achievable rates known as the generalized mutual information (GMI) and the LM rate, and overview their derivations and properties. In addition, we survey several improved rates via multi-user coding techniques, as well as recent developments and challenges in establishing converse bounds, and an analogous mismatched encoding problem in rate-distortion theory. Throughout the monograph, we highlight a variety of applications and connections with other prominent information theory problems.

READ FULL TEXT
research
02/23/2022

Lattices from Linear Codes: Source and Channel Networks

In this paper, we consider the information-theoretic characterization of...
research
07/13/2018

Information-Theoretic Limits of Strategic Communication

In this article, we investigate strategic information transmission over ...
research
01/31/2018

Noncoherent LDPC-Coded Physical-Layer Network Coding using Multitone FSK

A noncoherent two-way relaying system is developed using physical-layer ...
research
03/29/2022

Mismatched Rate-Distortion Theory: Ensembles, Bounds, and General Alphabets

In this paper, we consider the mismatched rate-distortion problem, in wh...
research
04/03/2020

Infomax Neural Joint Source-Channel Coding via Adversarial Bit Flip

Although Shannon theory states that it is asymptotically optimal to sepa...
research
12/02/2022

A Theory of Semantic Communication

Semantic communication is an emerging topic that has received a wide ran...
research
01/10/2019

Towards an Algebraic Network Information Theory: Simultaneous Joint Typicality Decoding

Consider a receiver in a multi-user network that wishes to decode severa...

Please sign up or login with your details

Forgot password? Click here to reset