arXiv:2310.17758 · IEEE International Symposium on Information Theory (ISIT)

Graph Neural Networks for Enhanced Decoding of Quantum LDPC Codes

Anqi Gong, Sebastian Cammerer, Joseph M. Renes

Published Jul 7, 2024• 11 citations

Abstract

In this work, we propose a fully differentiable iterative decoder for quantum low-density parity-check (LDPC) codes. The proposed algorithm is composed of classical belief propagation (BP) decoding stages and intermediate graph neural network (GNN) layers. Both components of the decoder are defined over the same sparse decoding graph enabling a seamless integration and scalability to large codes. The core idea is to use the GNN component between consecutive BP runs so that the knowledge from the previous BP run can be leveraged to better initialize the next BP run. This enables the proposed decoder to learn to compensate for sub-optimal BP decoding graphs that result from the design constraints of quantum LDPC codes. Since the entire decoder remains differentiable, gradient descent-based training is possible. We compare the error rate performance of the proposed decoder against various post-processing methods such as random perturbation, enhanced feedback, augmentation, and ordered-statistics decoding (OSD) and show that a carefully designed training process lowers the error-floor significantly. As a result, our proposed decoder outperforms the former three methods using significantly fewer post-processing attempts. The source code of our experiments is available online.

DOI: 10.1109/isit57864.2024.10619589

Related papers

Graph Neural Networks for Channel Decoding

Sebastian Cammerer, Jakob Hoydis, Fayçal Ait Aoudia +1 more

In this work, we propose a fully differentiable graph neural network (GNN)-based architecture for channel decoding and showcase a competitive decoding performance for various coding schemes, such as low-density parity-check (LDPC) and BCH codes. The idea is to let a neural network (NN) learn a generalized message passing algorithm over a given graph that represents the forward error correction (FEC) code structure by replacing node and edge message updates with trainable functions. Contrary to many other deep learning-based decoding approaches, the proposed solution enjoys scalability to arbitrary block lengths and the training is not limited by the curse of dimensionality. We benchmark our proposed decoder against state-of-the-art in conventional channel decoding as well as against recent deep learning-based results. For the (63,45) BCH code, our solution outperforms weighted belief propagation (BP) decoding by approximately 0.4 dB with significantly less decoding iterations and even for 5G NR LDPC codes, we observe a competitive performance when compared to conventional BP decoding. For the BCH codes, the resulting GNN decoder can be fully parametrized with only 9640 weights.

arXiv:2207.14742IEEE Globecom Workshops (GC Wkshps)Dec 4, 202258 citations

Decoding Quantum LDPC Codes Using Graph Neural Networks

Vukan Ninković, Ognjen Kundačina, Dejan Vukobratović +2 more

In this paper, we propose a novel decoding method for Quantum Low-Density Parity-Check (QLDPC) codes based on Graph Neural Networks (GNNs). Similar to the Belief Propagation (BP)-based QLDPC decoders, the proposed GNN-based QLDPC decoder exploits the sparse graph structure of QLDPC codes and can be implemented as a message-passing decoding algorithm. We compare the proposed GNN-based decoding algorithm against selected classes of both conventional and neural–enhanced QLDPC decoding algorithms across several QLDPC code designs. The simulation results demonstrate excellent performance of GNN-based decoders along with their low complexity compared to competing methods.

arXiv:2408.05170GlobecomDec 8, 202410 citations

HyperNQ: A Hypergraph Neural Network Decoder for Quantum LDPC Codes

Ameya S. Bhave, Navnil Choudhury, Kanad Basu

Quantum computing requires effective error correction strategies to mitigate noise and decoherence. Quantum Low-Density Parity-Check (QLDPC) codes have emerged as a promising solution for scalable Quantum Error Correction (QEC) applications by supporting constant-rate encoding and a sparse parity-check structure. However, decoding QLDPC codes via traditional approaches such as Belief Propagation (BP) suffers from poor convergence in the presence of short cycles. Machine learning techniques like Graph Neural Networks (GNNs) utilize learned message passing over their node features; however, they are restricted to pairwise interactions on Tanner graphs, which limits their ability to capture higher-order correlations. In this work, we propose HyperNQ, the first Hypergraph Neural Network (HGNN)- based QLDPC decoder that captures higher-order stabilizer constraints by utilizing hyperedges-thus enabling highly expressive and compact decoding. We use a two-stage message passing scheme and evaluate the decoder over the pseudo-threshold region. Below the pseudo-threshold mark, HyperNQ improves the Logical Error Rate (LER) up to 84% over BP and 50% over GNN-based strategies, demonstrating enhanced performance over the existing state-of-the-art decoders.

cs.LGCross-listedarXiv:2511.01741International Conference on CommunicationsNov 4, 20250 citations

Graph model-aided optimal iterative decoding technique for LDPC in optical fiber communication

Qinghua Tian, Yiqun Pan, Xiangjun Xin +10 more

The neural networks offer iteration capability for low-density parity-check (LDPC) decoding with superior performance at transmission. However, to cope with increasing code length and rate, the complexity of the neural network increases significantly. This is due to the large amount of feature extraction required to maintain the error correction capability. Based on this gap, we design a new iterative LDPC decoding technique named graph model neural network-belief propagation (GMNN-BP). GMNN-BP uses graph models as a link between deep learning and belief propagation (BP) algorithms, combining the advantages of both. Compared to traditional fully connected neural network decoders, the GMNN-BP decoding has the substantial benefit of avoiding learning and judging codeword categories directly from a large amount of data and requiring less training data as well. The proposed algorithm is verified by simulation and experiment and is tested by using IEEE 802.3ca standard LDPC code word. The results show that the GMNN-BP decoding algorithm is superior to the BP-based iterative decoding method under the same number of iterations, and the maximum gain can reach 1.9dB. When achieving the same performance, the GMNN-BP decoding algorithm only requires half the number of iterations of other algorithms.

Optics ExpressDec 19, 20247 citations

Machine learning message-passing for the scalable decoding of QLDPC codes

Arshpreet Singh Maan, Alexandru Paler

We present Astra, a novel and scalable decoder using graph neural networks. In general, Quantum Low Density Parity Check (QLDPC) decoding is based on Belief Propagation (BP, a variant of message-passing) and requires time intensive post-processing methods such as Ordered Statistics Decoding (OSD). Our decoder works on the Tanner graph, similarly to BP. Without using any post-processing, Astra achieves higher thresholds and better Logical Error Rates (LER) compared to BPOSD, both for surface codes trained up to distance 11 and Bivariate Bicycle (BB) codes trained up to distance 18. Moreover, we can successfully extrapolate the decoding functionality: we decode high distances (surface code up to distance 25 and BB code up to distance 34) by using decoders trained on lower distances. Extrapolated Astra achieves better LER than BPOSD for BB codes. Astra(+OSD) achieves orders of magnitude lower logical error rates for BB codes compared to BP(+OSD).

arXiv:2408.07038npj Quantum InformationMay 17, 202517 citations

Graph Neural Network-Based LDPC Decoding for Beyond 5G Communication Systems

Ambar Bajpai

Abstract In the evolving landscape of wireless communication, particularly in Beyond 5G (B5G) systems, channel coding must meet increasingly demanding requirements for reliability, adaptability, and low latency. Traditional decoding algorithms such as Belief Propagation (BP), while effective in structured environments, lack the flexibility to adapt to dynamic and noisy channel conditions. This paper presents a novel Graph Neural Network (GNN)-based approach for decoding Low-Density Parity-Check (LDPC) codes, leveraging the inherent bipartite graph structure of Tanner graphs. The proposed decoder learns data-driven message-passing strategies that outperform BP across a wide range of signal-to-noise ratios (SNRs) and block lengths.Our implementation integrates Python-based GNN modeling with MATLAB-based LDPC encoding and benchmarks the decoding performance under additive white Gaussian noise (AWGN) channels. Experimental results demonstrate that the GNN-based decoder achieves significantly lower bit error rates (BER), faster convergence, and superior robustness to noise variability compared to BP, particularly at medium-to-high SNR levels. Furthermore, an ablation study validates the architectural efficiency of shallow GNNs with attention mechanisms and skip connections. This work highlights the potential of machine learning-enhanced decoders in redefining the physical layer of next-generation wireless networks and sets the foundation for scalable, adaptive, and intelligent decoding systems in B5G and 6G architectures.

Jul 28, 20250 citations