DeepAI AI Chat
Log In Sign Up

Design of Capacity-Approaching Low-Density Parity-Check Codes using Recurrent Neural Networks

by   Eleni Nisioti, et al.

In this paper, we model Density Evolution (DE) using Recurrent Neural Networks (RNNs) with the aim of designing capacity-approaching Irregular Low-Density Parity-Check (LDPC) codes for binary erasure channels. In particular, we present a method for determining the coefficients of the degree distributions, characterizing the structure of an LDPC code. We refer to our RNN architecture as Neural Density Evolution (NDE) and determine the weights of the RNN that correspond to optimal designs by minimizing a loss function that enforces the properties of asymptotically optimal design, as well as the desired structural characteristics of the code. This renders the LDPC design process highly configurable, as constraints can be added to meet applications' requirements by means of modifying the loss function. In order to train the RNN, we generate data corresponding to the expected channel noise. We analyze the complexity and optimality of NDE theoretically, and compare it with traditional design methods that employ differential evolution. Simulations illustrate that NDE improves upon differential evolution both in terms of asymptotic performance and complexity. Although we focus on asymptotic settings, we evaluate designs found by NDE for finite codeword lengths and observe that performance remains satisfactory across a variety of channels.


page 1

page 2

page 3

page 4


Analysis of Low-Density Parity-Check Codes over Finite Integer Rings for the Lee Channel

We study the performance of low-density parity-check (LDPC) codes over f...

Degree-degree Correlated Low-density Parity-check Codes Over a Binary Erasure Channel

Most existing works on analyzing the performance of a random ensemble of...

Rate-Adaptive Protograph MacKay-Neal Codes

A class of rate-adaptive protograph MacKay-Neal (MN) codes is introduced...

Short Non-Binary Low-Density Parity-Check Codes for Phase Noise Channels

This work considers the design of short non-binary low-density parity-ch...

Design of Irregular SC-LDPC Codes With Non-Uniform Degree Distributions by Linear Programing

In this paper, we propose a new design method of irregular spatially-cou...

On Generalized LDPC Codes for 5G Ultra Reliable Communication

Generalized low-density parity-check (GLDPC) codes, where single parity-...

Spatially Coupled LDPC Codes with Non-uniform Coupling for Improved Decoding Speed

We consider spatially coupled low-density parity-check codes with finite...