Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Globecom

Scaling Deep Learning-Based Decoding of Polar Codes via Partitioning

Sebastian Cammerer, Tobias Gruber, Jakob Hoydis, Stephan ten Brink

Published Dec 1, 2017• 203 citations
Publisher

Abstract

The training complexity of deep learning-based channel decoders scales exponentially with the codebook size and therefore with the number of information bits. Thus, neural network decoding (NND) is currently only feasible for very short block lengths. In this work, we show that the conventional iterative decoding algorithm for polar codes can be enhanced when sub-blocks of the decoder are replaced by neural network (NN) based components. Thus, we partition the encoding graph into smaller sub-blocks and train them individually, closely approaching maximum a posteriori (MAP) performance per sub-block. These blocks are then connected via the remaining conventional belief propagation decoding stage(s). The resulting decoding algorithm is non-iterative and inherently enables a highlevel of parallelization, while showing a competitive bit error rate (BER) performance. We examine the degradation through partitioning and compare the resulting decoder to state-of-the art polar decoders such as successive cancellation list and belief propagation decoding.

DOI
10.1109/glocom.2017.8254811

Related papers

Improved polar decoder based on deep learning

Weihong Xu, Zhizhen Wu, Yeong-Luh Ueng +2 more

Deep learning recently shows strong competitiveness to improve polar code decoding. However, suffering from prohibitive training and computation complexity, the conventional deep neural network (DNN) is only possible for very short code length. In this paper, the main problems of deep learning in decoding are well solved. We first present the multiple scaled belief propagation (BP) algorithm, aiming at obtaining faster convergence and better performance. Based on this, deep neural network decoder (NND) with low complexity and latency, is proposed for any code length. The training only requires a small set of zero codewords. Besides, its computation complexity is close to the original BP. Experiment results show that the proposed (64,32) NND with 5 iterations achieves even lower bit error rate (BER) than the 30-iteration conventional BP and (512, 256) NND also outperforms conventional BP decoder with same iterations. The hardware architecture of basic computation block is given and folding technique is also considered, saving about 50% hardware cost.

SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems•Oct 1, 2017•157 citations

A BP-NN Decoding Algorithm for Polar Codes

Chen Wen, Jian Xiong, Lin Gui +1 more

Polar code is selected for the 5-th generation of wireless communication standard. Meanwhile, with the demand of low latency in 5G and great success in deep learning area, neural network decoder (NND) becomes a promising candidate for future decoder. However, NND is currently only feasible for very short code lengths. In this paper, we proposed a belief propagation-neural network (BP-NN) algorithm for polar codes based on partitioning. The core of our algorithm is replacing subblock of belief propagation (BP) decoder with NNDs, and using BP decoding framework to connect them. In addition, we also introduce a weight function to complete the message propagation process. Simulation results show the proposed algorithm reduces the decoding delay compared to the traditional BP algorithm and have a well bit error rate (BER) performance. At the same time, it also suitable for long polar codes.

International Conference on Wireless Communications and Signal Processing (WCSP)•Oct 1, 2019•4 citations

Neural Successive Cancellation List Decoding of Polar Codes

Stefano Negrini, Velio Tralli

Neural Network Decoders (NNDs) have been recently considered and investigated as an alternative to the classical algorithms for decoding Polar Codes. In particular, a class of partitioned decoders has been proposed where modified Successive Cancellation (SC) or Belief Propagation (BP) algorithms exploit the neural network decoding of short sublocks. Although NNDs work as one-shot decoders with small decoding latency, the performance of these decoders, in comparison with classic approaches, still suffers from some losses; this fact limits their application to codes with short/medium length. In this article we introduce the novel Neural Successive Cancellation List (NSCL) decoder, as a partitioned version of the SC decoder operating on a list of L multiple decoding candidates that are built with the decoded sub-blocks obtained from a set of NNDs working in parallel at each partition. This decoder significantly improves the BER performance of the non-list version under the same code length. Hence, it reduces the intrinsic loss of performance given by the use of NNDs and allows the application of NN-based decoding to longer codewords.

IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)•Aug 1, 2020•0 citations

Decoding of Polar Code by Machine Learning

Yi Jian, Rongke Liu

In this paper, we proposed a block neural network (BlockNN) algorithm for polar code. We equally divide the 2nbit polar code into many small sub-blocks according to the encoding rules of polar code, then put these sub-blocks into the neural network of the same structure for processing. This decoding algorithm is non-iterative and inherently enables a high level of parallelization, while showing a competitive BER(bit error arte) performance. On the aspect of hardware implementation, this decoding structure of the neural network can be multiplexed and the computational complexity does not increase with the code length, only related to the size of the block.

IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)•Jun 1, 2019•0 citations

Improved Polar Decoder Utilizing Neural Network in Fast Simplified Successive-Cancellation Decoding

Jiaxin Fang, Chunwu Liu

Polar codes using successive-cancellation decoding always suffer from high latency for its serial nature. Fast simplified successive-cancellation decoding algorithm improves the situation in theoretically but not performs well as expected in practical for the workload of nodes identification and the existence of many short blocks. Meanwhile, Neural network (NN) based decoders have appeared as potential candidates to replace conventional decoders for polar codes. But the exponentially increasing training complexity with information bits is unacceptable which means it is only suitable for short codes. In this paper, we present an improvement that increases decoding efficiency without degrading the error-correction performance. The long polar codes are divided into several sub-blocks, some of which can be decoded adopting fast maximum likelihood decoding method and the remained parts are replaced by several short codes NN decoders. The result shows that time steps the proposed algorithm need only equal to 79.8% of fast simplified successive-cancellation decoders require. Moreover, it has up to 21.2 times faster than successive-cancellation decoding algorithm. More importantly, the proposed algorithm decreases the hardness when applying in some degree.

Journal of Computer and Communications•Jan 1, 2020•2 citations

Improved Recurrent Neural Network based BP Decoding Algorithm for Polar Codes

Xue-lu DENG, Da-qin PENG

In recent years, the emerging Deep Learning (DL) technology has made progress in the field of decoding. Current polar code neural network decoder has faster convergence speed and better Bit Error Rate (BER) performance than Belief Propagation (BP) decoding. However, it still has the problem of high computational complexity. Therefore, in order to improve this problem, this paper adopts the idea of improving information update in the iterative process, and proposes a Recurrent Neural Network (RNN) Offset Min-Sum (OMS) BP decoding algorithm that improves Left information update (RNN-OMSBP-L) . The simulation results show that, compared with the Deep Neural Network (DNN) BP(DNN-BP) decoding algorithm, this algorithm replaces all multiplications with a cost of 6.25% addition. Compared with the current optimized RNN OMS and approximate BP(RNN-OMS-BP) decoding algorithm, the decoding algorithm in this paper uses improved information to reduce 25% of the addition operations with almost no loss in BER performance, while saving part of the storage space overhead. Under the same BER performance, it reduces the number of iterations by 37.5%.

•Aug 1, 2022•0 citations
The training complexity of deep learning-based channel decoders scales exponentially with the codebook size and therefore with the number of information bits. Thus, neural network decoding (NND) is currently only feasible for very short block lengths. In this work, we show that the conventional iterative decoding algorithm for polar codes can be enhanced when sub-blocks of the decoder are replaced by neural network (NN) based components. Thus, we partition the encoding graph into smaller sub-blocks and train them individually, closely approaching maximum a posteriori (MAP) performance per sub-block. These blocks are then connected via the remaining conventional belief propagation decoding stage(s). The resulting decoding algorithm is non-iterative and inherently enables a highlevel of parallelization, while showing a competitive bit error rate (BER) performance. We examine the degradation through partitioning and compare the resulting decoder to state-of-the art polar decoders such as successive cancellation list and belief propagation decoding.
Deep learning recently shows strong competitiveness to improve polar code decoding. However, suffering from prohibitive training and computation complexity, the conventional deep neural network (DNN) is only possible for very short code length. In this paper, the main problems of deep learning in decoding are well solved. We first present the multiple scaled belief propagation (BP) algorithm, aiming at obtaining faster convergence and better performance. Based on this, deep neural network decoder (NND) with low complexity and latency, is proposed for any code length. The training only requires a small set of zero codewords. Besides, its computation complexity is close to the original BP. Experiment results show that the proposed (64,32) NND with 5 iterations achieves even lower bit error rate (BER) than the 30-iteration conventional BP and (512, 256) NND also outperforms conventional BP decoder with same iterations. The hardware architecture of basic computation block is given and folding technique is also considered, saving about 50% hardware cost.
Polar code is selected for the 5-th generation of wireless communication standard. Meanwhile, with the demand of low latency in 5G and great success in deep learning area, neural network decoder (NND) becomes a promising candidate for future decoder. However, NND is currently only feasible for very short code lengths. In this paper, we proposed a belief propagation-neural network (BP-NN) algorithm for polar codes based on partitioning. The core of our algorithm is replacing subblock of belief propagation (BP) decoder with NNDs, and using BP decoding framework to connect them. In addition, we also introduce a weight function to complete the message propagation process. Simulation results show the proposed algorithm reduces the decoding delay compared to the traditional BP algorithm and have a well bit error rate (BER) performance. At the same time, it also suitable for long polar codes.
Neural Network Decoders (NNDs) have been recently considered and investigated as an alternative to the classical algorithms for decoding Polar Codes. In particular, a class of partitioned decoders has been proposed where modified Successive Cancellation (SC) or Belief Propagation (BP) algorithms exploit the neural network decoding of short sublocks. Although NNDs work as one-shot decoders with small decoding latency, the performance of these decoders, in comparison with classic approaches, still suffers from some losses; this fact limits their application to codes with short/medium length. In this article we introduce the novel Neural Successive Cancellation List (NSCL) decoder, as a partitioned version of the SC decoder operating on a list of L multiple decoding candidates that are built with the decoded sub-blocks obtained from a set of NNDs working in parallel at each partition. This decoder significantly improves the BER performance of the non-list version under the same code length. Hence, it reduces the intrinsic loss of performance given by the use of NNDs and allows the application of NN-based decoding to longer codewords.
In this paper, we proposed a block neural network (BlockNN) algorithm for polar code. We equally divide the 2nbit polar code into many small sub-blocks according to the encoding rules of polar code, then put these sub-blocks into the neural network of the same structure for processing. This decoding algorithm is non-iterative and inherently enables a high level of parallelization, while showing a competitive BER(bit error arte) performance. On the aspect of hardware implementation, this decoding structure of the neural network can be multiplexed and the computational complexity does not increase with the code length, only related to the size of the block.
Polar codes using successive-cancellation decoding always suffer from high latency for its serial nature. Fast simplified successive-cancellation decoding algorithm improves the situation in theoretically but not performs well as expected in practical for the workload of nodes identification and the existence of many short blocks. Meanwhile, Neural network (NN) based decoders have appeared as potential candidates to replace conventional decoders for polar codes. But the exponentially increasing training complexity with information bits is unacceptable which means it is only suitable for short codes. In this paper, we present an improvement that increases decoding efficiency without degrading the error-correction performance. The long polar codes are divided into several sub-blocks, some of which can be decoded adopting fast maximum likelihood decoding method and the remained parts are replaced by several short codes NN decoders. The result shows that time steps the proposed algorithm need only equal to 79.8% of fast simplified successive-cancellation decoders require. Moreover, it has up to 21.2 times faster than successive-cancellation decoding algorithm. More importantly, the proposed algorithm decreases the hardness when applying in some degree.
In recent years, the emerging Deep Learning (DL) technology has made progress in the field of decoding. Current polar code neural network decoder has faster convergence speed and better Bit Error Rate (BER) performance than Belief Propagation (BP) decoding. However, it still has the problem of high computational complexity. Therefore, in order to improve this problem, this paper adopts the idea of improving information update in the iterative process, and proposes a Recurrent Neural Network (RNN) Offset Min-Sum (OMS) BP decoding algorithm that improves Left information update (RNN-OMSBP-L) . The simulation results show that, compared with the Deep Neural Network (DNN) BP(DNN-BP) decoding algorithm, this algorithm replaces all multiplications with a cost of 6.25% addition. Compared with the current optimized RNN OMS and approximate BP(RNN-OMS-BP) decoding algorithm, the decoding algorithm in this paper uses improved information to reduce 25% of the addition operations with almost no loss in BER performance, while saving part of the storage space overhead. Under the same BER performance, it reduces the number of iterations by 37.5%.