On the Interpretability of Neural Network Decoders

Stefan Krastanov, Liang Jiang

Yuto Nakamura, Nobuhiko Miki, Satoshi SUYAMA +1 more

Xiangyu Chen, Min Ye

Liang Lv, Yurong Wang, Yi Fang +1 more

The paper carries out an in-depth investigation on the neural decoder design for protograph low-density parity-check (LDPC) codes. To be specific, based on the model-driven method, we propose a new type of protograph neural decoder with the parallel network (ParNet) decoding structure, called neural shuffled offset min-sum (NSOMS) decoder. The ParNet uses the model-driven method to unfold shuffled LDPC decoding algorithms into the interpretable network. Furthermore, with the aid of the over-estimation value (OEV), we optimize the training method to accelerate the convergence speed of the proposed decoding network. Theoretical and simulation results indicate that the proposed NSOMS decoder exhibits desirable performance compared to the state-of-the-art counterparts. Hence, the proposed NSOMS decoder can be regarded as a terrific solution for high-reliability communications.

Lukas Bödeker, Luc J. B. Kusters, Markus Müller

Abstract Neural‐network (NN) based decoders are becoming increasingly popular in the field of quantum error correction (QEC), including for decoding of state‐of‐the‐art quantum computation experiments. In this work, established interpretability methods are used from the field of machine learning, to introduce a toolbox to achieve an understanding of the underlying decoding logic of NN decoders, which have been trained but otherwise typically operate as black‐box models. To illustrate the capabilities of the employed interpretability method, based on the Shapley value approximation, an examplary case study of a NN decoder is provided that is trained for flag‐qubit based fault‐tolerant (FT) QEC with the Steane code. The interpretation of particular decoding decisions of the NN is analysed, by doing so it is revealed how the NN learns to capture fundamental structures in the information gained from syndrome and flag qubit measurements, in order to come to a FT correction decision. Further, it is showed that the understanding of how the NN obtains a decoding decision can be used on the one hand to identify flawed processing of error syndrome information by the NN, resulting in decreased decoding performance, as well as for well‐informed improvements of the NN architecture. The diagnostic capabilities of the interpretability method presented here can help ensure successful application of machine learning for decoding of QEC protocols.

Alexander J. Weissblut