Algorithmic Computability and Approximability of Capacity-Achieving Input Distributions

02/25/2022
by   Holger Boche, et al.
0

The capacity of a channel can usually be characterized as a maximization of certain entropic quantities. From a practical point of view it is of primary interest to not only compute the capacity value, but also to find the corresponding optimizer, i.e., the capacity-achieving input distribution. This paper addresses the general question of whether or not it is possible to find algorithms that can compute the optimal input distribution depending on the channel. For this purpose, the concept of Turing machines is used which provides the fundamental performance limits of digital computers and therewith fully specifies tasks are algorithmically feasible in principle. It is shown for discrete memoryless channels that it is impossible to algorithmically compute the capacity-achieving input distribution, where the channel is given as an input to the algorithm (or Turing machine). Finally, it is further shown that it is even impossible to algorithmically approximate these input distributions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/27/2022

Capacity of Finite State Channels with Feedback: Algorithmic and Optimization Theoretic Properties

The capacity of finite state channels (FSCs) with feedback has been show...
research
05/04/2023

Algorithmic Computability of the Capacity of Gaussian Channels with Colored Noise

Designing capacity achieving coding schemes for the band-limited additiv...
research
08/30/2020

Shannon Meets Turing: Non-Computability and Non-Approximability of the Finite State Channel Capacity

The capacity of finite state channels (FSCs) has been established as the...
research
05/20/2020

Capacities and Optimal Input Distributions for Particle-Intensity Channels

This work introduces the particle-intensity channel (PIC) as a model for...
research
05/22/2023

Cooperative Channel Capacity Learning

In this paper, the problem of determining the capacity of a communicatio...
research
01/15/2023

Computability of Optimizers

Optimization problems are a staple of today's scientific and technical l...

Please sign up or login with your details

Forgot password? Click here to reset