A New Construction of Nonbinary Polar Codes with Two-stage Polarization

01/24/2018 ∙ by Peiyao Chen, et al. ∙ Xidian University SUN YAT-SEN UNIVERSITY 0

In this paper, we propose a new class of nonbinary polar codes with two-stage polarization, where the outer polarization (symbol-level polarization) kernel is a nonbinary matrix resembling Arıkan's kernel, and the inner polarization (bit-level polarization) kernel is a properly designed binary matrix. The encoder/decoder of the proposed nonbinary polar codes have the same structure as the original binary polar codes, admitting an easily configurable and flexible implementation. This is an obvious advantage over the nonbinary polar codes based on Reed-Solomon (RS) codes. Simulation results show that, compared with modified RS-based polar codes, our proposed nonbinary polar codes can achieve similar performance but with a smaller list size. When compared with binary polar codes, the proposed nonbinary polar codes exhibit better performance and lower decoding latency (benefitted from the fact that multiple bits can be decoded as a symbol simultaneously).



There are no comments yet.


page 1

page 2

page 3

page 4

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

I Introduction

Binary polar codes, proposed by Arıkan [1], were proved to be able to achieve the symmetric-capacity of binary-input discrete memoryless channels (DMCs) with explicit coding structures as well as low encoding and decoding complexity. Polarization effect exists by using nested transformations with the binary kernel (called Arıkan’s kernel) in conjunction with a successive cancellation (SC)-based decoder. As the code length tends to infinity, bit-channels polarize to be either nearly noiseless or useless, and the capacity can be approached by employing only the noiseless bit-channels for data transmission. It was shown that bit-channels can also be polarized with such a generator matrix that none of its column permutations is an upper triangle matrix [2]

. Thus the original polar codes can be generalized by applying different kernels. The probability of block error for polar codes under SC decoding is found to be

for any , where denotes the exponent of the kernel matrix [2]. The exponent of Arıkan’s kernel is , which can be improved by considering larger or nonbinary matrices [2]. Therefore, BCH-generator-matrices as polarization kernels were considered in [2], which yields an exponent greater than at size . Binary kernels with maximum exponents of dimensions up to sixteen were provided in [3].

Another way to increase the exponent is to extend binary polar codes to a nonbinary setting. In [4], Şaşoǧlu et al. proved that nonbinary polar codes with arbitrary finite input-alphabet sizes can achieve symmetric-capacity by decomposing underlying symbol channels into a set of subchannels with prime input alphabet sizes, and they also showed that all DMCs can be polarized by randomized constructions. In 2014, Chiu [5] proposed a new approach, by using channel symbol permutations, to prove that polar codes polarize arbitrary -ary input randomized channels. Nonbinary polar codes based on an -ary Reed-Solomon (RS) matrix were proposed by Mori and Tanaka [6], which have exponents of order for all and can be made arbitrarily close to 1 as becomes large. In 2016, Cheng [7] et al. applied a four-dimensional RS matrix over the finite field GF(4) as the kernel and showed that better error-correcting performance can be achieved compared with binary polar codes.

In this paper, we propose a new class of nonbinary polar codes with two-stage polarization. The outer polarization for symbol-level, referred to as multiplicative repetition-based construction, is based on a -ary matrix , where acts as a multiplier and may vary for nested Kronecker operations. The inner polarization for bit-level, referred to as polarization mapping, is then applied to each coded symbol to further intensify the polarization. With this two-stage polarization, a -ary input channel is treated as several binary input channels. As a result, partially-frozen symbols may arise. That is, there may exist symbols containing both frozen bits and active bits. This is different from existing constructions, in which a symbol is either fully-frozen or fully-active. An initial motivation of such a hybrid construction is to disperse information bits to more symbols, which may benefit from high order modulations. The partially-frozen symbol can be further utilized to improve the error-correcting performance by an active-check construction. An efficient successive cancellation list (SCL) decoding is also introduced for the proposed polar codes, which has a similar structure to that of the Arıkan’s polar codes [8][9]. This is an obvious advantage over the existing RS-generator-matrix based polar codes, which require much more computations than ours due to their very different decoding structure from that of the original polar codes. In addition, with the proposed code structure, lower latency can be achieved compared with binary polar codes. Simulation results show that the proposed codes perform better than binary polar codes with BPSK. Simulation results also show that the performance gain can be increased with the increase of the field order. Moreover, the proposed codes also exhibit an outstanding performance with high-order modulations.

Ii System Model

Let GF() be the finite field with , where is a positive integer greater than unity. Let be a primitive element of GF(). Then form all the elements of GF(). Each element GF() can be represented by an -tuple over GF.

Fig. 1: System model for nonbinary polar codes.

The system model under consideration is depicted in Fig. 1. The -ary polar encoder accepts as input a -ary sequence of length or, equivalently, a binary sequence of length . This input sequence is formed as follows. First, a binary sequence of length is encoded by a CRC-encoder; the checked sequence is then formatted as a binary sequence of length by inserting properly frozen bits and active-check bits according to the code construction; finally, the binary sequence is converted into the symbol sequence with GF() () as usual. To intensify the polarization, a polarization mapper is applied to each coded symbol GF() () before the signal mapping. Apparently, the overall code rate .

Suppose that a -dimensional signal constellation of size is used. A signal mapper maps the polar coded symbols to modulated symbols . Without loss of generality, we assume that is a multiple of

. If necessary, zero bits are padded to the coded symbols. With the assumption that

are transmitted over the AWGN channel, the received symbols are given by


where and

are independent and identically distributed Gaussian random variables with zero mean and variance

per dimension. At the receiver, the demapper computes posteriori probabilities (APPs) and delivers them to the SCL decoder. In the SCL decoder, best paths are considered at each decoding stage. Finally, the

candidates from SCL decoder are checked by a CRC decoder successively, and the one with the best metric among the candidates which can pass the CRC detection is determined as the estimate


Denote the average transmitted energy per symbol by . Then the average received SNR is given by SNR = , where denotes the average energy per information bit.

Iii Nonbinary Polar Codes with Two-Stage Polarization

Iii-a Symbol-Level Polarization with MR Construction

We extend binary polar codes to nonbinary polar codes by considering a -ary kernel given by

where GF(). With as the generator matrix, for each GF(), we have the coded sequence . In the case of , has the same form as Arıkan’s, and is repeated once and then superimposed on . In the nonbinary case with , we see is a multiplicative repetition of . For this reason, we call the construction multiplicative repetition (MR)-based construction for convenience.

Let and represent the multiplier for the -th Kronecker operation. Then the generator matrix with the code length is given by

where is a permutation matrix for bit-reversal operation, and the multiplier () is randomly chosen from the nonzero elements set of GF(). All multipliers are known both to the transmitter and to the receiver.

The MR-based construction is similar to the permutation construction proposed in [4]. Thus, with the Proposition 1 in [4], we can prove (omitted here due to space limitation) that the MR-based transformation polarize -ary discrete memoryless channels. This is referred to as symbol-level polarization.

Iii-B Bit-Level Polarization with Polarization Mapping

Different from conventional nonbinary polar codes, in which only symbol-level polarization is discussed and the construction is based on the symbol-level, we introduce the bit-level polarization by a polarization mapping to each coded symbol.

The mapping pattern is based on an binary polarization matrix with the maximum polarization rate among the matrices of the same size. Decompose each -ary input channel into bit-channels by treating each coded symbol GF(

) as a binary vector

. With the matrix , each coded symbol is mapped to . For example, assuming that and , we have . With this process, bits in the same symbol become dependent. Similar to binary polar codes, it can be proved that polarization exists in the decomposed bit-channels by regarding the mapping process as a binary encoding with the polarization matrix. It is worth noting that, without the polarization mapping, the choice of information index set via bit-channel reliabilities will be equivalent to that via symbol-channel reliabilities.

Iii-C Code Construction

Our code construction is different from the conventional -ary code construction in the sense that we sort bit-channel reliabilities. This effective construction is attributed to the existence of the polarization mapping. Assume that , GF(), represents the channel conditional probabilities given by the demapper. Due to the similar structure to binary polar codes, the recursive formulas for the SC decoding are given as


where , , , and .

A genie-aided SC decoder is used to compute the bit-channel reliabilities for -ary polar codes with , where information bits are uniformly generated. For and , denote . The -th bit-channel within the -th symbol-channel is then referred to as the -th bit-channel, whose reliability is computed under the assumption that symbols () are available at the SC decoder. Denote the index set of bit-channels with the largest capacities by , whose size is determined by the code rate. The bit-channels indexed by will be used to transmit active bits. Given this, frozen bits will be typically distributed as shown in Fig. 2(b).

Fig. 2: Input formats of the bits/symbols to the encoder.

We distinguish the symbols into three types, i.e., information symbols, partially-frozen symbols, and frozen symbols in terms of the number of active bits in a symbol. Both information symbols and partially-frozen symbols are known as unfrozen symbols, collectively denoted by . Then denote the set of frozen symbol indices, where for any , all corresponding .

The frozen bits in partially-frozen symbols can be used as active-check bits, facilitating the SCL decoder to detect and prune error paths in time. For this end, consider the symbols with only one active bit, referred to as one-bit symbols, collectively denoted by . Denote by and () the bit-channel indices with lowest reliability and highest reliability for the -th symbol, respectively. Let , followed by , the next adjacent one-bit symbol (if any). We retransmit the -th bit (active bit in the -th symbol) once as an active-check bit at the -th bit-channel. Then, at the decoder, the -th symbol is split by considering the constraint that the -th bit is equal to the -th decoded (estimated) bit. We call such a construction active-check construction.

Iii-D Decoding Algorithm

We consider CRC-aided SCL decoding for the proposed -ary polar codes. Assume that the maximum decoding paths are kept at each decoding stage. Since a partially-frozen symbol can only take values from a subset of GF(), the decoding path for an unfrozen symbol is split into at most branches. Then we choose the most likely paths from all the possible extended paths () according to their path metrics. After SCL decoding, the decoder outputs the estimated information sequence given by the decoding path with the maximum path metric among the paths which can pass the CRC. The main CRC-aided SCL decoding algorithm for two-stage polarization-based polar codes is shown in Algorithm 1.

Input: received channel probabilities
Output: estimated source sequence
1 , .
2 for  to  do
3        for  to  do
4               if  then
5                      Set and remain all paths.
6              else
7                      if   then
8                             , .
9                             , for all
10                     else
11                             , for all .
12                             , for all .
13                      Compute the set : .
14                      if ,  for all  then
16                     else
17                             For all GF () with vector form ().
18                             if for all  then
19                                   .
21                      Calculate the conditional probabilities according to the set using Eq.(2) and Eq.(3).
24       if  then
25               Sort the conditional probabilities in descending order, and select the most likely paths with the largest probabilities.
27       if  then
28               for  to  do
29                         .
33Find the most likely path which passes the CRC.
Algorithm 1

Iii-E Decoding Latency

Let us first consider the latency of SC decoding. Denote by functions and the node update equations (2) and (3), respectively. According to [10], for binary polar codes with , clock cycles (CLKs) are required for the SC decoder, where both functions and can be carried out in a single CLK. For the proposed -ary polar codes, CLKs are needed for the function due to additions for each unit , and the number of CLKs required for the function is the same as that of binary cases. Thus, a total of CLKs are required for the proposed -ary SC decoder.

An -size SCL decoder can be viewed as the combination of copies of SC component decoders. In addition, the SCL decoder needs to sort (for worst case) path metrics and selects the largest metrics for each decoded bit, thus, extra CLKs are required to carry out sorting and selecting functions. Using Bitonic sorter [11], the total number of stages is , where each stage contains compare-and-select (CAS) units consisting of one comparator and a 2-to-2 MUX. Generally, an intermediate variable (or register) is required to swap two numbers resulting in 3 CLKs [12]. Since only unfrozen symbols require sorting and selecting functions, at most CLKs are needed for -ary polar decoder to sort and select paths. For binary decoder, the number of unfrozen bits is . The CLKs required by SC-decoder and SCL-decoder for binary and -ary polar codes are tabulated in Table I for comparison.

Polar codes SC-decoder SCL-decoder
TABLE I: Clock Cycles Comparison

Iv Numerical Results and Analysis

In this section, error-correcting performances are provided for the proposed nonbinary (NB) polar codes, where both BPSK and high-order modulations over AWGN channels are considered. The polarization matrices

are applied for the polarization mapping of GF, GF, GF and GF, respectively.

Example 1: Consider the proposed -ary polar codes with BPSK over the AWGN channel. Two rate- codes with equivalent code length of =512 and =768 are simulated. In Fig. 3(a), both -ary polar codes and -ary polar codes are constructed by Monte-Carlo method at dB. In Fig. 3(b), both -ary polar codes and -ary polar codes are constructed by Monte-Carlo method at dB. The FER performance are given under both SC decoding and 8-bit CRC-aided SCL decoding method.

For reference, the performance of comparable binary polar codes, constructed by GA method at dB, are also given in Fig. 3. The quasi-uniform puncturing (QUP) method in [13] is used to adapt the code length.

From Fig. 3, we can see that our proposed nonbinary polar codes outperform binary polar codes with BPSK over the AWGN channel. The coding gain is increased with the increase of the field order. Moreover, from Table I, it can be checked that the latency of our proposed nonbinary polar codes is lower than that of binary cases, and that can be decreased with the increase of the field order.

Fig. 3: Performance comparison between binary polar codes and nonbinary polar codes with BPSK over the AWGN channel: is , and is for GF, for GF, for GF, and for GF.

Example 2: Consider the proposed -ary polar codes with -ary modulations over the AWGN channel. Rate-1/2 codes with two modulation schemes -QAM and -QAM are simulated. In Fig. 4(a), the proposed -ary polar codes with are constructed by Monte-Carlo method at dB. In Fig. 4(b), the proposed -ary polar codes with are constructed by Monte-Carlo method at dB. The 16-bit CRC-aided SCL decoding with various list sizes are applied.

For comparison, the performance of comparable modified RS-based -ary polar codes in [6] are also given in Fig. 4, where the codes are constructed by Monte-Carlo method at the aforementioned design-SNRs. Also considered for comparison are bit-interleaved coded-modulation (BICM) scheme [14][15] and multilevel coding (MLC) scheme [16][17] using comparable binary polar codes with -ary QAM, where the codes are constructed by Monte-Carlo method at dB for -QAM and dB for -QAM. For the BICM-based scheme, the bit-interleaver designed in [15] is applied, and the QUP method is used to adapt the code length. For the MLC-based scheme, individual coding levels are employed. The rate allocations are obtained via the capacity rule in [16]. The SP labeling is applied to the MLC-based scheme, and Gray labeling is employed to other schemes.

(a) -QAM
(b) -QAM
Fig. 4: Performance comparison with 16-QAM and 64-QAM over the AWGN channel.

From Fig. 4, we see that our proposed nonbinary polar codes combined with high-order modulations exhibit better performance than BICM-based scheme and can achieve similar performance but with a smaller list size compared with modified RS-based polar codes. Under -QAM, compared with MLC-based scheme, about dB gain can be obtained by our proposed polar codes with at FER.

V Conclusion

We have presented a new class of nonbinary polar codes constructed with two-stage polarization, where the symbol-level polarization is based on a -ary kernel, which is a variation of Arıkan’s kernel, and the bit-level polarization is considered by using a polarization mapping with a designed binary matrix. Simulation results show that the proposed nonbinary polar codes perform better than binary polar codes with BPSK and high-order modulations over the AWGN channel. Furthermore, compared with modified RS-based polar codes, the proposed polar codes can achieve similar performance but with a smaller list size for high-order modulations.


  • [1] E. Arıkan, “Channel polarization: A method for constructing capacity achieving codes for symmetric binary-input memoryless channels,” IEEE Trans. Inf. Theory, vol. 55, no. 7, pp. 3051-3073, Jul. 2009.
  • [2] S. Korada, E. Şaşoǧlu and R. Urbanke, “Polar Codes: Characterization of exponent, bounds, and constructions,” IEEE Trans. Inf. Theory, vol. 56, no. 12, pp. 6253-6264, Dec. 2010.
  • [3] H. P. Lin, S. Lin, and K. A. S. Abdel-Ghaffar, “Linear and nonlinear binary kernels of polar codes of small dimensions with maximum exponents,” IEEE Trans. Inf. Theory, vol. 61, no. 10, pp. 5253-5270, Aug. 2015.
  • [4] E. Şaşoǧlu, E. Telatar, and E. Arıkan, “Polarization for arbitrary discrete memoryless channels,” in Proc. IEEE Inf. Theory Workshop, pp. 144-148, Oct. 2009.
  • [5] M. Chiu, “Non-binary polar codes with channel symbol permutations,” in Proc. IEEE Int. Symp. Inf. Theory Its Applications, pp. 433-437, Oct. 2014.
  • [6] R. Mori, and T. Tanaka, “Non-binary polar codes using Reed-Solomon codes and algebraic geometry codes,” in Proc. IEEE Inf. Theory Workshop, pp. 1-5, Sep. 2010.
  • [7] N. Cheng, R. Zhang, and Y. Ge et al., “Encoder and list decoder of Reed-Solomon kernel based polar codes,” in Proc. IEEE Int. Conf. Wireless Commun. Signal Process., pp. 1-6, Oct. 2016.
  • [8] I. Tal and A. Vardy, “List decoding of polar codes,” in Proc. IEEE Int. Symp. Inf. Theory, pp. 1-5, Aug. 2011.
  • [9] K. Chen, K. Niu, and J. R. Lin, “List successive cancellation decoding of polar codes,” Electronics Lett., vol. 48, no. 9, pp. 500-501, Apr. 2012.
  • [10] C. Leroux, I. Tal, A. Vardy, and W. J. Gross, “Hardware architecture for successive cancellation decoding of polar codes,” in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Process., pp. 1665-1668, May. 2011.
  • [11] A. Balatsoukas-Stimming, M. Parizi, and A. Burg, “On metric sorting for successive cancellation list decoding of polar codes,” in Proc. IEEE Int. Symp. Circuits and Systems, pp. 1993-1996, Jun. 2015.
  • [12] S. Shi, B. Han, J. Gao, and Y. Wang, “Enhanced successive cancellation list decoding of polar codes,” IEEE Commun. Lett., vol.21, no.6, pp. 1233-1236, Nov. 2017.
  • [13] K. Niu, K. Chen, and J. R. Lin, “Beyond turbo codes: Rate-compatible punctured polar codes,” in Proc. IEEE Int. Conf. Commun., pp. 3423-3427, Jun. 2013.
  • [14] K. Chen, K. Niu and J. Lin, “An efficient design of bit-interleaved polar coded modulation,” in Proc. IEEE Int. Symp. Personal Indoor and Mobile Radio Commun., Sep. 2013.
  • [15] P. Chen, M. Xu, B. Bai, and X. Ma, “Design of polar coded 64-QAM,” in Proc. IEEE Int. Symp. Turbo Codes Iterative Inf. Process., pp. 251-255, Sep. 2016.
  • [16] M. Seidl, A. Schenk, C. Stierstorfer, and J. Huber, “Polar-coded modulation,” IEEE Trans. Commun., vol.61, no.10, pp. 4108-4119, Oct. 2013.
  • [17] G. Böcherer, T. Prinz, P. Yuan, and F. Steiner, “Efficient polar code construction for higher-order modulation,” in Proc. IEEE Wireless Commun. and Networking Conference Workshops, Mar. 2017.