Neural Mutual Information Estimation for Channel Coding: State-of-the-Art Estimators, Analysis, and Performance Comparison

06/29/2020
by   Rick Fritschek, et al.
0

Deep learning based physical layer design, i.e., using dense neural networks as encoders and decoders, has received considerable interest recently. However, while such an approach is naturally training data-driven, actions of the wireless channel are mimicked using standard channel models, which only partially reflect the physical ground truth. Very recently, neural network based mutual information (MI) estimators have been proposed that directly extract channel actions from the input-output measurements and feed these outputs into the channel encoder. This is a promising direction as such a new design paradigm is fully adaptive and training data-based. This paper implements further recent improvements of such MI estimators, analyzes theoretically their suitability for the channel coding problem, and compares their performance. To this end, a new MI estimator using a “reverse Jensen” approach is proposed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/15/2021

Discriminative Mutual Information Estimation for the Design of Channel Capacity Driven Autoencoders

The development of optimal and efficient machine learning-based communic...
research
03/07/2019

Deep Learning for Channel Coding via Neural Mutual Information Estimation

End-to-end deep learning for communication systems, i.e., systems whose ...
research
11/14/2021

Neural Capacity Estimators: How Reliable Are They?

Recently, several methods have been proposed for estimating the mutual i...
research
10/26/2022

InfoShape: Task-Based Neural Data Shaping via Mutual Information

The use of mutual information as a tool in private data sharing has rema...
research
07/07/2021

Discriminative Mutual Information Estimators for Channel Capacity Learning

Channel capacity plays a crucial role in the development of modern commu...
research
06/30/2020

Data-driven Regularization via Racecar Training for Generalizing Neural Networks

We propose a novel training approach for improving the generalization in...
research
06/10/2019

A Regression Approach to Certain Information Transmission Problems

A general information transmission model, under independent and identica...

Please sign up or login with your details

Forgot password? Click here to reset