Error correction is used to correct any errors that may arise when sending any message, as errors are prone to appear due to noise. For classical codes, there are many decoders used, for example, belief propagation. Unfortunately, these classical decoders are less efficient for quantum codes. A proposed remedy to improve the decoders efficiency is to use a neural network for decoding. In this thesis, we will implement belief propagation on the toric code and check its efficiency. We will see that for few errors, belief propagation works, but it fails for other cases. We also introduce the modifications needed for neural belief propagation, a modification of the original algorithm that integrates a neural network on the algorithm structure.
Error correction is used to correct any errors that may arise when sending any message, as errors are prone to appear due to noise. For classical codes, there are many decoders used, for example, belief propagation. Unfortunately, these classical decoders are less efficient for quantum codes. A proposed remedy to improve the decoders efficiency is to use a neural network for decoding. In this thesis, we will implement belief propagation on the toric code and check its efficiency. We will see that for few errors, belief propagation works, but it fails for other cases. We also introduce the modifications needed for neural belief propagation, a modification of the original algorithm that integrates a neural network on the algorithm structure.
In the quest for fault-tolerant quantum computation, the delicate nature of qubits demands the need for robust quantum error correction. Quantum error correcting codes, the quantum counterpart to classical error correcting codes in information theory, have been developed to address the unique challenges quantum bits face against the noise of their environment in storing information. These codes include but are not limited to the Kitaev surface code, toric code, rotated surface code, generalized bicycle code, and bivariate bicycle code. Fast and reliable decoders for these quantum error correcting codes are needed to correct errors and achieve fault tolerance on these qubits. The belief propagation algorithm, which is a efficient and reliable heuristic for decoding classical low-density parity check codes, has been generalized to different types of quantum error correction codes. Paired with the ordered statistics decoding algorithm as a post-processing step from the soft outputs of the belief propagation decoder, belief propagation and ordered statistics decoding has been one of the most promising avenues of efficient quantum error correction. This thesis combines the state-of-the-art belief propagation and ordered statistics decoding algorithms with the exploration of the neural belief propagation algorithm to leverage classical deep learning machines to learn message passing patterns in decoding the newest quantum codes, the rotated surface code and bivariate bicycle code. The neural network exploits the local lattice structure of these codes to adjust the trainable weights and biases to more learn message update patterns more efficiently than the vanilla belief propagation algorithm. In this thesis, we prove a new threshold for the physical error rate on the rotated surface code using a neural belief propagation algorithm and ordered statistics decoding that consistently outperforms the threshold established by the vanilla belief propagation algorithm with ordered statistics decoding. We additionally show the results for similar efforts on the bivariate bicycle codes, and discuss the difficulties in achieving a threshold using the current neural belief propagation algorithms.
Quantum error correction (QEC) is critical for scalable fault-tolerant quantum computing. Topological codes, such as the toric code, offer hardware-efficient architectures but their Tanner graphs contain many girth-4 cycles that degrade the performance of belief-propagation (BP) decoding. For this reason, BP decoding is typically followed by a more complex second stage decoder such as minimum-weight perfect matching. These combined decoders achieve a remarkable performance, albeit at the cost of increased complexity. In this paper we propose two key improvements for the decoding of toric code. The first one is replacing the BP decoder by a neural BP decoder, giving rise to the neural belief-matching decoder which substantially decreases the average decoding complexity. The main drawback of this approach is the high cost associated with the training of the neural BP decoder. To address this issue, we impose a convolutional architecture on the neural BP decoder, enabling weight sharing across the spatially homogeneous structure of the code's factor graph. This design allows a model trained on a modest-size topological code to be directly transferred to much larger instances, preserving decoding quality while dramatically lowering the training burden. Our numerical experiments on toric-code lattices of various sizes demonstrate that this technique does not result in a noticeable loss in performance.
Belief-propagation (BP) decoders play a vital role in modern coding theory, but they are not suitable to decode quantum error-correcting codes because of a unique quantum feature called error degeneracy. Inspired by an exact mapping between BP and deep neural networks, we train neural BP decoders for quantum low-density parity-check codes with a loss function tailored to error degeneracy. Training substantially improves the performance of BP decoders for all families of codes we tested and may solve the degeneracy problem which plagues the decoding of quantum low-density parity-check codes.
Abstract To improve the decoding performance of quantum error-correcting codes in asymmetric noise channels, a neural network-based decoding algorithm for bias-tailored quantum codes is proposed. The algorithm consists of a biased noise model, a neural belief propagation decoder, a convolutional optimization layer, and a multi-objective loss function. The biased noise model simulates asymmetric error generation, providing a training dataset for decoding. The neural network, leveraging dynamic weight learning and a multi-objective loss function, mitigates error degeneracy. Additionally, the convolutional optimization layer enhances early-stage convergence efficiency. Numerical results show that for bias-tailored quantum codes, our decoder performs much better than the belief propagation (BP) with ordered statistics decoding (BP + OSD). Our decoder achieves an order of magnitude improvement in the error suppression compared to higher-order BP + OSD. Furthermore, the decoding threshold of our decoder for surface codes reaches a high threshold of 20%.
Noise is a major obstacle in the development of practical schemes for quantum computation and communication. Similar to the case of classical communication, this noise can be protected against by employing a code, which provides a means for encoding quantum states prior to transmission and allows for errors to be inferred, and hopefully corrected, by a decoder at the receiver. Unfortunately, designing good codes and decoders is typically a difficult problem. This thesis focuses on developing low-complexity heuristic approaches to three such problems: the design of modified belief propagation decoders for quantum low-density parity-check codes, the design of stabilizer codes for asymmetric channels, and the design of codeword stabilized codes. Quantum low-density parity-check codes are stabilizer codes with low-weight generators. Such codes permit low-complexity decoding via the use of belief propagation, which is an iterative message passing algorithm that takes place on a factor graph defined by the code. However, the performance of such a decoder is limited both by code structure and the degenerate nature of quantum errors. To overcome these limitations, at least in part, a number of modifications to belief propagation are developed. Central among these is the augmented decoder, which in the case of a decoding error, iteratively reattempts decoding using modified factor graph. This heuristic modification simply involves the duplication of a randomly selected subset of the graph’s check nodes, which are in one-to-one correspondence with the code’s stabilizer generators. Across a range of codes, it is shown that the decoders developed perform as well as or better than other modified decoders presented in literature. For a number of channels of physical interest, phase-flip errors occur far more frequently than bit-flip errors. When transmitting across these so-called asymmetric channels, the decoding error rate can be minimized by tailoring the code used to the channel. However, assessing the performance of codes on a given channel is made difficult by the #P-completeness of optimal decoding. To address this complexity, it is shown that the decoding error rate can be accurately approximated using only a small fraction of the possible errors caused by the channel. This approximation is then used to identify a number of cyclic stabilizer codes that perform well on two different asymmetric channels. To further build on this, a heuristic is demonstrated for assessing code performance based on the decoding error rate of an associated classical code. The complexity of calculating this classical error rate is relatively low, and it is shown that it can be used as the basis for a hill-climbing search algorithm. Such searches have yielded a large number of highly performant codes satisfying various structure constraints. The family of codeword stabilized codes encompasses both the stabilizer codes as well as many of the best known nonadditive codes. Constructing a standard form codeword stabilized code is a matter of selecting a simple undirected graph and a binary classical code. This makes designing optimal codes difficult as the number of possible graphs grows exponentially with code length, and the clique search required to construct the classical code is NP-hard. To address the exponential growth of the search space, a heuristic is developed for assessing graphs. This heuristic is then employed by a genetic algorithm that also makes use of a novel crossover operation based on spectral bisection, which is show to be superior to more standard crossover operations. With a graph selected, it is demonstrated that the complexity of the clique search required to construct the associated classical code can be mitigated through the use of a heuristic clique finding algorithm. A number of best known codes are presented that have been found using this approach.
Research on mitigating errors in computing and communication systems has grown with their widespread use. In quantum computing, error correction is crucial as errors can quickly propagate, undermining results and the theoretical speedup over classical systems. Quantum error-correcting codes, particularly topological codes, are a key focus. These codes map parity check matrices to graphs on d-dimensional surfaces, with our research centered on the 3D toric code. Effective decoders must be robust to noise, with performance improving as code size increases, but their complexity should scale polynomially with lattice size for practicality. We propose a neural network with inductive bias, leveraging equivariance to generalize efficiently from a smaller input subset. Additionally, we explore transformer networks for error correction and compare these methods to existing techniques for decoding errors in the 3D toric code, highlighting their strengths and limitations.