Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2607.14589

Quasi-Belief Propagation and Neural-Network Check Node Processing for BCH Codes

Guangwen Li

Published Jul 16, 2026• 0 citations
arXivHTMLPDF

Abstract

This paper proposes a quasi-BP decoding scheme for BCH codes that preserves the parallelizable structure of belief propagation while exploiting code automorphisms and optimized redundant parity-check matrices. To eliminate the computationally expensive $\tanh$ and $\tanh^{-1}$ functions in check node updates, we further introduce a neural-network-based variant that replaces them with a lightweight convolutional neural network trained under a triple-constraint loss function enforcing non-negativity and order consistency. Simulation results for three BCH codes demonstrate that quasi-BP decoding achieves competitive frame error rate performance, with a gap within 0.25 decibels compared with belief propagation decoding of an LDPC code of similar blocklength. The neural-network-based variant incurs negligible performance loss while enabling stable deployment with arithmetic operations on hardware accelerators. Concatenation with an ordered statistics decoding variant further bridges the gap to the maximum-likelihood bound. Hence, the proposed schemes offer a viable path toward high-throughput, low-latency decoding of BCH codes in next-generation communication systems.

DOI
10.48550/arxiv.2607.14589

Related papers

Quasi-BP for BCH Codes and its Optimization

Guangwen Li

This paper proposes a quasi-belief propagation decoder for BCH codes that systematically integrates domain knowledge--specifically, channel noise variance, the cyclic property of the codes, and the deliberate redundancy in their parity-check matrices--to enable efficient iterative decoding. We rigorously formalize this parallelizable decoder within an information-theoretic framework by tracking mutual information evolution through the constituent variable and check decoders, thereby validating the use of scattered EXIT charts as a tool for optimizing the decoder's parameters. At each iteration, an input dilation operation expands the set of messages, while a subsequent merging operation accelerates mutual information growth, ensuring rapid convergence. The proposed decoder achieves decoding performance approaching that of LDPC codes with comparable rate and blocklength, effectively pioneering the feasible deployment of BP-like decoding for high-density parity-check codes. The generality and robustness of the scheme are demonstrated through extensive simulations across codes of varying rates and blocklengths.

arXiv:2604.04066•Apr 5, 2026•0 citations

A Model-Driven Quasi-ResNet Belief Propagation Neural Network Decoder for LDPC Codes

Liangsi Ma, Bei Liu, Xin Su +1 more

For the Belief Propagation (BP) algorithm of low-density parity-check (LDPC) codes, existing deep learning methods have a limited performance improvement and it is difficult to train deep-level networks. In this paper, a model-driven quasi-residual network (Quasi-ResNet) BP decoding architecture is proposed for LDPC codes to further improve the performance of standard BP decoding. This method feeds the reliable messages calculated in current iteration into the next iteration based on the shortcut connection, and adjusts the weight of shortcut connection based on the error Back Propagation algorithm of neural network to determine the optimal genetic proportion of reliable messages. The decoding architecture is composed of a model-driven deep neural network (DNN) and shortcut connection. Simulation results show that the decoder can not only unfold more layers quickly compared with the DNN-based BP decoder, but also further improve the decoding performance.

IEEE Symposium on Computers and Communications (ISCC)•Jul 9, 2023•1 citation

Generalization Bounds for Neural Belief Propagation Decoders

Sudarshan Adiga, Xin Wei Xiao, Ravi Tandon +2 more

Machine learning based approaches are being increasingly used for designing decoders for next generation communication systems. One widely used framework is neural belief propagation (NBP), which unfolds the belief propagation (BP) iterations into a deep neural network and the parameters are trained in a data-driven manner. NBP decoders have been shown to improve upon classical decoding algorithms. In this paper, we investigate the generalization capabilities of NBP decoders. Specifically, the generalization gap of a decoder is the difference between empirical and expected bit-error-rate(s). We present new theoretical results which bound this gap and show the dependence on the decoder complexity, in terms of code parameters (blocklength, message length, variable/check node degrees), decoding iterations, and the training dataset size. Results are presented for both regular and irregular parity-check matrices. To the best of our knowledge, this is the first set of theoretical results on generalization performance of neural network based decoders. We present experimental results to show the dependence of generalization gap on the training dataset size, and decoding iterations for different codes.

IEEE International Symposium on Information Theory (ISIT)•Jun 25, 2023•1 citation

Generalization Bounds for Neural Belief Propagation Decoders

Sudarshan Adiga, Xin Wei Xiao, Ravi Tandon +2 more

Machine learning based approaches are being increasingly used for designing decoders for next generation communication systems. One widely used framework is neural belief propagation (NBP), which unfolds the belief propagation (BP) iterations into a deep neural network and the parameters are trained in a data-driven manner. NBP decoders have been shown to improve upon classical decoding algorithms. In this paper, we investigate the generalization capabilities of NBP decoders. Specifically, the generalization gap of a decoder is the difference between empirical and expected bit-error-rate(s). We present new theoretical results which bound this gap and show the dependence on thedecoder complexity, in terms of code parameters (blocklength, message length, variable/check node degrees), decoding iterations, and the training dataset size. Results are presented for both regular and irregular parity-check matrices. To the best of our knowledge, this is the first set of theoretical results on generalization performance of neural network based decoders. We present experimental results to show the dependence of generalization gap on the training dataset size, and decoding iterations for different codes.

arXiv:2305.10540•IEEE Transactions on Information Theory•Feb 1, 2024•14 citations

Graph Neural Networks for Channel Decoding

Sebastian Cammerer, Jakob Hoydis, Fayçal Ait Aoudia +1 more

In this work, we propose a fully differentiable graph neural network (GNN)-based architecture for channel decoding and showcase a competitive decoding performance for various coding schemes, such as low-density parity-check (LDPC) and BCH codes. The idea is to let a neural network (NN) learn a generalized message passing algorithm over a given graph that represents the forward error correction (FEC) code structure by replacing node and edge message updates with trainable functions. Contrary to many other deep learning-based decoding approaches, the proposed solution enjoys scalability to arbitrary block lengths and the training is not limited by the curse of dimensionality. We benchmark our proposed decoder against state-of-the-art in conventional channel decoding as well as against recent deep learning-based results. For the (63,45) BCH code, our solution outperforms weighted belief propagation (BP) decoding by approximately 0.4 dB with significantly less decoding iterations and even for 5G NR LDPC codes, we observe a competitive performance when compared to conventional BP decoding. For the BCH codes, the resulting GNN decoder can be fully parametrized with only 9640 weights.

arXiv:2207.14742•IEEE Globecom Workshops (GC Wkshps)•Dec 4, 2022•58 citations

Iterative decoding of short BCH codes and its post-processing

Guangwen Li, Xiao Yu

Effective iterative decoding of short BCH codes faces two primary challenges: identifying an appropriate parity-check matrix and accelerating decoder convergence. To address these issues, we propose a systematic scheme to derive an optimized parity-check matrix through a heuristic approach. This involves a series of binary sum and row shift operations, resulting in a low-density, quasi-regular column weight distribution with a reduced number of shortest cycles in the underlying redundant Tanner graph. For the revised normalized min-sum decoder, we concurrently integrate three types of random permutations into the alternated messages across iterations, leading to significantly faster convergence compared to existing methods. Furthermore, by utilizing the iterative trajectories of failed normalized min-sum decoding, we enhance the reliability measurement of codeword bits with the assistance of a neural network model from prior work, which accommodates more failures for the post-processing of ordered statistics decoding. Additionally, we report the types of undetected errors for the design of iterative decoders for short BCH codes, which potentially challenge efforts to approach the maximum likelihood limit. Extensive simulations demonstrate that the proposed hybrid framework achieves an attractive balance between performance, latency, and complexity.

arXiv:2411.13876•Nov 21, 2024•0 citations
This paper proposes a quasi-BP decoding scheme for BCH codes that preserves the parallelizable structure of belief propagation while exploiting code automorphisms and optimized redundant parity-check matrices. To eliminate the computationally expensive tanh⁡\tanhtanh and tanh⁡−1\tanh^{-1}tanh−1 functions in check node updates, we further introduce a neural-network-based variant that replaces them with a lightweight convolutional neural network trained under a triple-constraint loss function enforcing non-negativity and order consistency. Simulation results for three BCH codes demonstrate that quasi-BP decoding achieves competitive frame error rate performance, with a gap within 0.25 decibels compared with belief propagation decoding of an LDPC code of similar blocklength. The neural-network-based variant incurs negligible performance loss while enabling stable deployment with arithmetic operations on hardware accelerators. Concatenation with an ordered statistics decoding variant further bridges the gap to the maximum-likelihood bound. Hence, the proposed schemes offer a viable path toward high-throughput, low-latency decoding of BCH codes in next-generation communication systems.
This paper proposes a quasi-belief propagation decoder for BCH codes that systematically integrates domain knowledge--specifically, channel noise variance, the cyclic property of the codes, and the deliberate redundancy in their parity-check matrices--to enable efficient iterative decoding. We rigorously formalize this parallelizable decoder within an information-theoretic framework by tracking mutual information evolution through the constituent variable and check decoders, thereby validating the use of scattered EXIT charts as a tool for optimizing the decoder's parameters. At each iteration, an input dilation operation expands the set of messages, while a subsequent merging operation accelerates mutual information growth, ensuring rapid convergence. The proposed decoder achieves decoding performance approaching that of LDPC codes with comparable rate and blocklength, effectively pioneering the feasible deployment of BP-like decoding for high-density parity-check codes. The generality and robustness of the scheme are demonstrated through extensive simulations across codes of varying rates and blocklengths.
For the Belief Propagation (BP) algorithm of low-density parity-check (LDPC) codes, existing deep learning methods have a limited performance improvement and it is difficult to train deep-level networks. In this paper, a model-driven quasi-residual network (Quasi-ResNet) BP decoding architecture is proposed for LDPC codes to further improve the performance of standard BP decoding. This method feeds the reliable messages calculated in current iteration into the next iteration based on the shortcut connection, and adjusts the weight of shortcut connection based on the error Back Propagation algorithm of neural network to determine the optimal genetic proportion of reliable messages. The decoding architecture is composed of a model-driven deep neural network (DNN) and shortcut connection. Simulation results show that the decoder can not only unfold more layers quickly compared with the DNN-based BP decoder, but also further improve the decoding performance.
Machine learning based approaches are being increasingly used for designing decoders for next generation communication systems. One widely used framework is neural belief propagation (NBP), which unfolds the belief propagation (BP) iterations into a deep neural network and the parameters are trained in a data-driven manner. NBP decoders have been shown to improve upon classical decoding algorithms. In this paper, we investigate the generalization capabilities of NBP decoders. Specifically, the generalization gap of a decoder is the difference between empirical and expected bit-error-rate(s). We present new theoretical results which bound this gap and show the dependence on the decoder complexity, in terms of code parameters (blocklength, message length, variable/check node degrees), decoding iterations, and the training dataset size. Results are presented for both regular and irregular parity-check matrices. To the best of our knowledge, this is the first set of theoretical results on generalization performance of neural network based decoders. We present experimental results to show the dependence of generalization gap on the training dataset size, and decoding iterations for different codes.
Machine learning based approaches are being increasingly used for designing decoders for next generation communication systems. One widely used framework is neural belief propagation (NBP), which unfolds the belief propagation (BP) iterations into a deep neural network and the parameters are trained in a data-driven manner. NBP decoders have been shown to improve upon classical decoding algorithms. In this paper, we investigate the generalization capabilities of NBP decoders. Specifically, the generalization gap of a decoder is the difference between empirical and expected bit-error-rate(s). We present new theoretical results which bound this gap and show the dependence on thedecoder complexity, in terms of code parameters (blocklength, message length, variable/check node degrees), decoding iterations, and the training dataset size. Results are presented for both regular and irregular parity-check matrices. To the best of our knowledge, this is the first set of theoretical results on generalization performance of neural network based decoders. We present experimental results to show the dependence of generalization gap on the training dataset size, and decoding iterations for different codes.
In this work, we propose a fully differentiable graph neural network (GNN)-based architecture for channel decoding and showcase a competitive decoding performance for various coding schemes, such as low-density parity-check (LDPC) and BCH codes. The idea is to let a neural network (NN) learn a generalized message passing algorithm over a given graph that represents the forward error correction (FEC) code structure by replacing node and edge message updates with trainable functions. Contrary to many other deep learning-based decoding approaches, the proposed solution enjoys scalability to arbitrary block lengths and the training is not limited by the curse of dimensionality. We benchmark our proposed decoder against state-of-the-art in conventional channel decoding as well as against recent deep learning-based results. For the (63,45) BCH code, our solution outperforms weighted belief propagation (BP) decoding by approximately 0.4 dB with significantly less decoding iterations and even for 5G NR LDPC codes, we observe a competitive performance when compared to conventional BP decoding. For the BCH codes, the resulting GNN decoder can be fully parametrized with only 9640 weights.
Effective iterative decoding of short BCH codes faces two primary challenges: identifying an appropriate parity-check matrix and accelerating decoder convergence. To address these issues, we propose a systematic scheme to derive an optimized parity-check matrix through a heuristic approach. This involves a series of binary sum and row shift operations, resulting in a low-density, quasi-regular column weight distribution with a reduced number of shortest cycles in the underlying redundant Tanner graph. For the revised normalized min-sum decoder, we concurrently integrate three types of random permutations into the alternated messages across iterations, leading to significantly faster convergence compared to existing methods. Furthermore, by utilizing the iterative trajectories of failed normalized min-sum decoding, we enhance the reliability measurement of codeword bits with the assistance of a neural network model from prior work, which accommodates more failures for the post-processing of ordered statistics decoding. Additionally, we report the types of undetected errors for the design of iterative decoders for short BCH codes, which potentially challenge efforts to approach the maximum likelihood limit. Extensive simulations demonstrate that the proposed hybrid framework achieves an attractive balance between performance, latency, and complexity.