Learned Belief-Propagation Decoding with Simple Scaling and SNR Adaptation

01/24/2019
by   Mengke Lian, et al.
0

We consider the weighted belief-propagation (WBP) decoder recently proposed by Nachmani et al. where different weights are introduced for each Tanner graph edge and optimized using machine learning techniques. Our focus is on simple-scaling models that use the same weights across certain edges to reduce the storage and computational burden. The main contribution is to show that simple scaling with few parameters often achieves the same gain as the full parameterization. Moreover, several training improvements for WBP are proposed. For example, it is shown that minimizing average binary cross-entropy is suboptimal in general in terms of bit error rate (BER) and a new "soft-BER" loss is proposed which can lead to better performance. We also investigate parameter adapter networks (PANs) that learn the relation between the signal-to-noise ratio and the WBP parameters. As an example, for the (32,16) Reed-Muller code with a highly redundant parity-check matrix, training a PAN with soft-BER loss gives near-maximum-likelihood performance assuming simple scaling with only three parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/04/2020

Learned Decimation for Neural Belief Propagation Decoders

We introduce a two-stage decimation process to improve the performance o...
research
11/27/2020

Pruning and Quantizing Neural Belief Propagation Decoders

We consider near maximum-likelihood (ML) decoding of short linear block ...
research
01/08/2018

Near Maximum Likelihood Decoding with Deep Learning

A novel and efficient neural decoder algorithm is proposed. The proposed...
research
07/16/2016

Learning to Decode Linear Codes Using Deep Learning

A novel deep learning method for improving the belief propagation algori...
research
07/21/2020

Towards Quantum Belief Propagation for LDPC Decoding in Wireless Networks

We present Quantum Belief Propagation (QBP), a Quantum Annealing (QA) ba...
research
02/24/2019

Fast Decoder for Overloaded Uniquely Decodable Synchronous Optical CDMA

In this paper, we propose a fast decoder algorithm for uniquely decodabl...
research
10/03/2022

Language-Aware Soft Prompting for Vision Language Foundation Models

This paper is on soft prompt learning for Vision & Language (V L) mode...

Please sign up or login with your details

Forgot password? Click here to reset