MIND: Maximum Mutual Information Based Neural Decoder

05/14/2022
by   Andrea M. Tonello, et al.
0

We are assisting at a growing interest in the development of learning architectures with application to digital communication systems. Herein, we consider the detection/decoding problem. We aim at developing an optimal neural architecture for such a task. The definition of the optimal criterion is a fundamental step. We propose to use the mutual information (MI) of the channel input-output signal pair. The computation of the MI is a formidable task, and for the majority of communication channels it is unknown. Therefore, the MI has to be learned. For such an objective, we propose a novel neural MI estimator based on a discriminative formulation. This leads to the derivation of the mutual information neural decoder (MIND). The developed neural architecture is capable not only to solve the decoding problem in unknown channels, but also to return an estimate of the average MI achieved with the coding scheme, as well as the decoding error probability. Several numerical results are reported and compared with maximum a-posteriori (MAP) and maximum likelihood (MaxL) decoding strategies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/15/2021

Discriminative Mutual Information Estimation for the Design of Channel Capacity Driven Autoencoders

The development of optimal and efficient machine learning-based communic...
research
02/25/2021

Dual MINE-based Neural Secure Communications under Gaussian Wiretap Channel

Recently, some researches are devoted to the topic of end-to-end learnin...
research
07/07/2021

Discriminative Mutual Information Estimators for Channel Capacity Learning

Channel capacity plays a crucial role in the development of modern commu...
research
10/14/2020

Decoding Methods for Neural Narrative Generation

Narrative generation is an open-ended NLP task in which a model generate...
research
10/08/2019

MIM: Mutual Information Machine

We introduce the Mutual Information Machine (MIM), an autoencoder model ...
research
10/04/2019

High Mutual Information in Representation Learning with Symmetric Variational Inference

We introduce the Mutual Information Machine (MIM), a novel formulation o...
research
09/11/2020

Capacity-Approaching Autoencoders for Communications

The autoencoder concept has fostered the reinterpretation and the design...

Please sign up or login with your details

Forgot password? Click here to reset