Journal of Experimental and Theoretical Physics Letters
Training Quantum Recurrent Neural Networks on a Josephson Integrated Circuit
S. S. Samarin, Aleksei Tolstobrov, S. V. Sanduleanu, Gleb Fedorov, Alexander A. Ryabov, V. V. Vanovskiy, Daria A. Kalacheva, Aleksey N. Bolgar, Viktor B. Lubsanov, Shamil Kadyrmetov, A. M. Muraviev, E. S. Alekseeva, Peter Shlykov, A. M. Yeremeyev, Andrei Vladimirovich Vasenin, A. Yu. Dmitriev, O. V. Astafiev
This work is devoted to solving the problem of processing numerical sequences using variational quantum algorithms implemented on a noisy intermediate-scale quantum computer. The quantum computing platform is an integrated circuit based on superconducting artificial atoms. The architecture of the quantum recurrent neural network is constructed using single- and two-qubit operations. At the simulation stage, we investigated the trainability of the model as a function of the number of qubits, as well as the encoded into the qubit states data amount and the encoding method. A comparison with classical architectures showed that on current quantum processors it is possible to achieve a prediction quality on the chosen machine-learning task that is comparable to that of models implemented on classical processors.
This work is devoted to solving the problem of processing numerical sequences using variational quantum algorithms implemented on a noisy intermediate-scale quantum computer. The quantum computing platform is an integrated circuit based on superconducting artificial atoms. The architecture of the quantum recurrent neural network is constructed using single- and two-qubit operations. At the simulation stage, we investigated the trainability of the model as a function of the number of qubits, as well as the encoded into the qubit states data amount and the encoding method. A comparison with classical architectures showed that on current quantum processors it is possible to achieve a prediction quality on the chosen machine-learning task that is comparable to that of models implemented on classical processors.
We implement a post-variational quantum neural network on a real HPC-QC system and show the feasibility of fully training this class of algorithms on current Noisy Intermediate-Scale Quantum (NISQ) devices, which are limited by noise, low number of qubits, and scarcity. Post-variational methods are hybrid classical-quantum Machine Learning algorithms that remove the need for quantum circuits evaluations during training, thus making them more suited to the availability constraints of physical quantum devices. We investigate the scalability of the algorithm to a higher number of qubits, larger datasets, and more elaborate models, giving insight for more efficient implementation. Experiments for an image classification task on a cutting-edge HPC-QC system show that post-variational quantum neural networks are fully trainable in reasonable times on a superconducting device. The models trained also show performance at least comparable to a variational approach, with one configuration showing a significant improvement in classification accuracy.
Recent developments in quantum computing and machine learning have propelled the interdisciplinary study of quantum machine learning. Sequential modeling is an important task with high scientific and commercial value. Existing VQC or QNN-based methods require significant computational resources to perform the gradient-based optimization of a larger number of quantum circuit parameters. The major drawback is that such quantum gradient calculation requires a large amount of circuit evaluation, posing challenges in current near-term quantum hardware and simulation software. In this work, we approach sequential modeling by applying a reservoir computing (RC) framework to quantum recurrent neural networks (QRNN-RC) that are based on classical RNN, LSTM and GRU. The main idea to this RC approach is that the QRNN with randomly initialized weights is treated as a dynamical system and only the final classical linear layer is trained. Our numerical simulations show that the QRNN-RC can reach results comparable to fully trained QRNN models for several function approximation and time series prediction tasks. Since the QRNN training complexity is significantly reduced, the proposed model trains notably faster. In this work we also compare to corresponding classical RNN-based RC implementations and show that the quantum version learns faster by requiring fewer training epochs in most cases. Our results demonstrate a new possibility to utilize quantum neural network for sequential modeling with greater quantum hardware efficiency, an important design consideration for noisy intermediate-scale quantum (NISQ) computers.
Recurrent neural networks are the foundation of many sequence-to-sequence models in machine learning, such as machine translation and speech synthesis. In contrast, applied quantum computing is in its infancy. Nevertheless there already exist quantum machine learning models such as variational quantum eigensolvers which have been used successfully e.g. in the context of energy minimization tasks. In this work we construct a quantum recurrent neural network (QRNN) with demonstrable performance on non-trivial tasks such as sequence learning and integer digit classification. The QRNN cell is built from parametrized quantum neurons, which, in conjunction with amplitude amplification, create a nonlinear activation of polynomials of its inputs and cell state, and allow the extraction of a probability distribution over predicted classes at each step. To study the model's performance, we provide an implementation in pytorch, which allows the relatively efficient optimization of parametrized quantum circuits with thousands of parameters. We establish a QRNN training setup by benchmarking optimization hyperparameters, and analyse suitable network topologies for simple memorisation and sequence prediction tasks from Elman's seminal paper (1990) on temporal structure learning. We then proceed to evaluate the QRNN on MNIST classification, both by feeding the QRNN each image pixel-by-pixel; and by utilising modern data augmentation as preprocessing step. Finally, we analyse to what extent the unitary nature of the network counteracts the vanishing gradient problem that plagues many existing quantum classifiers and classical RNNs.
Abstract In noisy intermediate-scale quantum era, the research on the combination of artificial intelligence and quantum computing has been greatly developed. Here we propose a quantum circuit-based algorithm to implement quantum residual neural networks, where the residual connection channels are constructed by introducing auxiliary qubits to data-encoding and trainable blocks in quantum neural networks. We prove that when this particular network architecture is applied to a l -layer data-encoding, the number of frequency generation forms extends from one, namely the difference of the sum of generator eigenvalues, to O(l2) O ( l 2 ) , and the flexibility in adjusting Fourier coefficients can also be improved. It indicates that residual encoding can achieve better spectral richness and enhance the expressivity of various parameterized quantum circuits. Extensive numerical demonstrations in regression tasks and image classification are offered. Our work lays foundation for the complete quantum implementation of classical residual neural networks and offers a quantum feature map strategy for quantum machine learning.
Deep learning is one of the most successful and far-reaching strategies used in machine learning today. However, the scale and utility of neural networks is still greatly limited by the current hardware used to train them. These concerns have become increasingly pressing as conventional computers are soon expected to approach the physical limitations that will slow their performance improvements in the near future. For these reasons, scientists have begun to explore alternative computing platforms, like quantum computers, for training neural networks. In recent years, variational quantum circuits have emerged as one of the most successful approaches to quantum deep learning on noisy intermediate scale quantum devices. We propose a hybrid quantum-classical neural network architecture where each neuron is a variational quantum circuit. We empirically analyze the performance of this hybrid neural network on a series of binary classification data sets using a simulated IBM universal quantum computer and a state-of-the-art IBM universal quantum computer. On the simulated hardware, we observe that the hybrid neural network achieves around 10% higher classification accuracy and 20% better minimization of the cost function than an individual variational quantum circuit. On the quantum hardware, we observe that each model only performs well when the qubit and gate count is sufficiently small.
Abstract Modeling temporal dependencies within quantum systems remains a key challenge for quantum machine learning. Current quantum neural networks largely depend on classical recurrent modules, which introduce optimization bottlenecks and coherence loss during sequence processing. To address this, we propose a fully quantum-native recurrent neural network (QRNN) for end-to-end sequential learning. Our architecture captures temporal dynamics through coherent unitary operations, avoiding external classical recurrence and mid-circuit state collapse. The proposed model was benchmarked against a classical recurrent neural network (RNN), quantum tensor networks, and state-of-the-art hybrid QRNN using the Origin Quantum superconducting platform. Experimental evaluations on nonlinear functions, complex dynamical systems, and meteorological datasets demonstrate that our quantum-native QRNN achieves improved prediction accuracy and exhibits enhanced capability in forecasting complex temporal features. For instance, on the relative humidity forecasting task, the proposed QRNN achieves a 73.5% reduction in Root mean square error compared to the hybrid VQRNN. This work establishes a robust framework for preserving coherence in pure quantum sequential processing, offering a scalable path for time-series forecasting on near-term quantum hardware.