Adversarial Neural Networks for Error Correcting Codes

12/21/2021
by   Hung T. Nguyen, et al.
11

Error correcting codes are a fundamental component in modern day communication systems, demanding extremely high throughput, ultra-reliability and low latency. Recent approaches using machine learning (ML) models as the decoders offer both improved performance and great adaptability to unknown environments, where traditional decoders struggle. We introduce a general framework to further boost the performance and applicability of ML models. We propose to combine ML decoders with a competing discriminator network that tries to distinguish between codewords and noisy words, and, hence, guides the decoding models to recover transmitted codewords. Our framework is game-theoretic, motivated by generative adversarial networks (GANs), with the decoder and discriminator competing in a zero-sum game. The decoder learns to simultaneously decode and generate codewords while the discriminator learns to tell the differences between decoded outputs and codewords. Thus, the decoder is able to decode noisy received signals into codewords, increasing the probability of successful decoding. We show a strong connection of our framework with the optimal maximum likelihood decoder by proving that this decoder defines a Nash equilibrium point of our game. Hence, training to equilibrium has a good possibility of achieving the optimal maximum likelihood performance. Moreover, our framework does not require training labels, which are typically unavailable during communications, and, thus, seemingly can be trained online and adapt to channel dynamics. To demonstrate the performance of our framework, we combine it with the very recent neural decoders and show improved performance compared to the original models and traditional decoding algorithms on various codes.

READ FULL TEXT
research
08/28/2021

High-Throughput VLSI Architecture for GRAND Markov Order

Guessing Random Additive Noise Decoding (GRAND) is a recently proposed M...
research
01/09/2020

Soft Maximum Likelihood Decoding using GRAND

Maximum Likelihood (ML) decoding of forward error correction codes is kn...
research
06/13/2022

Rethinking: Deep-learning-based Demodulation and Decoding

In this paper, we focus on the demodulation/decoding of the complex modu...
research
07/18/2023

qecGPT: decoding Quantum Error-correcting Codes with Generative Pre-trained Transformers

We propose a general framework for decoding quantum error-correcting cod...
research
06/01/2022

Neural Decoding with Optimization of Node Activations

The problem of maximum likelihood decoding with a neural decoder for err...
research
01/16/2023

Machine Learning-Aided Efficient Decoding of Reed-Muller Subcodes

Reed-Muller (RM) codes achieve the capacity of general binary-input memo...

Please sign up or login with your details

Forgot password? Click here to reset