Discriminative Mutual Information Estimation for the Design of Channel Capacity Driven Autoencoders

11/15/2021
by   Nunzio A. Letizia, et al.
0

The development of optimal and efficient machine learning-based communication systems is likely to be a key enabler of beyond 5G communication technologies. In this direction, physical layer design has been recently reformulated under a deep learning framework where the autoencoder paradigm foresees the full communication system as an end-to-end coding-decoding problem. Given the loss function, the autoencoder jointly learns the coding and decoding optimal blocks under a certain channel model. Because performance in communications typically refers to achievable rates and channel capacity, the mutual information between channel input and output can be included in the end-to-end training process, thus, its estimation becomes essential. In this paper, we present a set of novel discriminative mutual information estimators and we discuss how to exploit them to design capacity-approaching codes and ultimately estimate the channel capacity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/11/2020

Capacity-Approaching Autoencoders for Communications

The autoencoder concept has fostered the reinterpretation and the design...
research
06/29/2020

Neural Mutual Information Estimation for Channel Coding: State-of-the-Art Estimators, Analysis, and Performance Comparison

Deep learning based physical layer design, i.e., using dense neural netw...
research
03/07/2019

Deep Learning for Channel Coding via Neural Mutual Information Estimation

End-to-end deep learning for communication systems, i.e., systems whose ...
research
04/20/2018

Achievable Information Rates for Nonlinear Fiber Communication via End-to-end Autoencoder Learning

Machine learning is used to compute achievable information rates (AIRs) ...
research
02/25/2021

Dual MINE-based Neural Secure Communications under Gaussian Wiretap Channel

Recently, some researches are devoted to the topic of end-to-end learnin...
research
05/14/2022

MIND: Maximum Mutual Information Based Neural Decoder

We are assisting at a growing interest in the development of learning ar...
research
07/07/2021

Discriminative Mutual Information Estimators for Channel Capacity Learning

Channel capacity plays a crucial role in the development of modern commu...

Please sign up or login with your details

Forgot password? Click here to reset