Journal of Physics Communications

A variational approach to quantum gated recurrent units

Andrea Ceschini, Antonello Rosato, Massimo Panella

Published Aug 1, 2024• 10 citations

Abstract

Abstract Quantum Recurrent Neural Networks are receiving an increased attention thanks to their enhanced generalization capabilities in time series analysis. However, their performances were bottlenecked by long training times and unscalable architectures. In this paper, we propose a novel Quantum Recurrent Neural Network model based on Quantum Gated Recurrent Units. It uses a learnable Variational Quantum Layer to process temporal data, interspersed with two classical layers to properly match the dimensionality of the input and output vectors. Such an architecture has fewer quantum parameters than existing Quantum Long Short-Term Memory models. Both the quantum networks were evaluated on periodic and real-world time series datasets, together with the classical counterparts. The quantum models exhibited superior performances compared to the classical ones in all the test cases. The Quantum Gated Recurrent Units outperformed the Quantum Long Short-Term Memory network despite having a simpler internal configuration. Moreover, the Quantum Gated Recurrent Units network demonstrated to be about 25% faster during the training and inference procedure over the Quantum Long Short-Term Memory. This improvement in speed comes with one less quantum circuit to be executed, suggesting that our model may offer a more efficient alternative for implementing Quantum Recurrent Neural Networks on both simulated and real quantum hardware.

DOI: 10.1088/2399-6528/ad6db7

Related papers

Evolving Hybrid Quantum-Classical GRU Architectures for Multivariate Time Series

Francesca De Falco, Leonardo Lavagna, Andrea Ceschini +2 more

Quantum Recurrent Neural Networks are gaining attention for their generalization capability in time series analysis. However, their performance are hindered by lengthy training times and non-scalability. This paper proposes a novel appli- cation for hybrid Quantum Gated Recurrent Units (QGRUs) focused on multivariate time-series forecasting. Our study demonstrates that these architectures outperform classical benchmarks. Through extensive innovative experiments and simulations, our results showcase the versatility and superiority of the hybrid approach, extending the capabilities of QGRUs especially in multidimensional data applications. In addition, the architecture at the basis of the QGRU has 25% fewer quantum parameters than existing Quantum Long Short-Term Memory models, and it is about 25% faster during training and inference stages, leading to feasible implemen- tations on both simulated and real quantum hardware.

Machine learning for signal processing ...Sep 22, 20240 citations

A Quantum Variational Approach to Prototypical Recurrent Unit

Mahyar Sadeghi Garjan, Tommaso Cesari, Michel Barbeau

We introduce a lightweight Quantum Prototypical Recurrent Unit (QPRU) that requires significantly fewer parameters than both classical recurrent architectures, such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), and quantum variants, including Quantum LSTM (QLSTM) and Quantum GRU (QGRU). Despite its compact design, the QPRU achieves competitive forecasting performance, matching state-of-the-art baselines while offering important structural and practical advantages, including enhanced scalability and a reduced number of trainable parameters.

arXiv:2609.04354International Conference on Quantum Communications, Networking, and Computing (QCNC)Apr 6, 20260 citations

Quantum-Enhanced Recurrent Neural Networks via Variational Quantum Gating for Battery State of Health Prediction

Yin Xu, Qinglin Liu, Li Gao +1 more

Accurate state-of-health (SOH) estimation for lithium-ion batteries remains a challenging problem due to complex electrochemical degradation mechanisms and long-range temporal dependencies. In this work, we propose a quantum-enhanced recurrent framework, termed QLSTM, in which variational quantum circuits are directly embedded into the gating mechanisms of long short-term memory networks. By replacing classical affine transformations with parameterized unitary operations, the proposed model introduces structured nonlinear transformations into the recurrent state-transition process. Extensive experiments on multiple benchmark battery datasets demonstrate that QLSTM consistently outperforms classical sequence models in both predictive accuracy and robustness, achieving significant reductions in mean absolute error (MAE), with improvements on the order of 20% compared with classical LSTM baselines. Ablation studies further confirm that these improvements arise primarily from quantum-enhanced gating rather than input-level transformations. Additional analyses on qubit scaling and noise robustness reveal that model performance is governed by a balance between expressive capacity and trainability. These results provide empirical evidence that embedding quantum computational primitives within recurrent architectures offers a structurally grounded approach to improving sequence modeling capability. The proposed framework establishes a new design paradigm for integrating quantum operators into temporal learning models, with potential applications in complex dynamical system prediction tasks.

quant-pharXiv:2604.20438Apr 23, 20260 citations

Hybrid Quantum-Classical Recurrent Neural Networks for Time Series Prediction

Andrea Ceschini, Antonello Rosato, Massimo Panella

This paper aims at solving time series prediction problems by means of a hybrid quantum-classical recurrent neural network. We propose a novel architecture based on stacked Long Short-Term Memory layers and a variational quantum layer. The latter employs a quantum feature map to embed input data into quantum states, which are then processed by a circuit ansatz. Finally, the expectation value of the circuit's outcome is taken over Pauli observables. Quantum properties such as superposition and entanglement are exploited to perform computations efficiently in a high-dimensional feature space. The proposed hybrid quantum-classical neural network is applied to a real-life challenging problem pertaining to the prediction of renewable energy time series. The comparison between the proposed approach and the classical counterpart shows that the former achieves better results in terms of prediction error, thus demonstrating better approximation of stochastic fluctuations and an overall effectiveness of the quantum variational approach also for prediction tasks.

International Joint Conference on Neural Networks (IJCNN)Jul 18, 202234 citations

Quantum Recurrent Neural Networks: Predicting the Dynamics of Oscillatory and Chaotic Systems

Yuan Chen, Abdul Q. M. Khaliq

In this study, we investigate Quantum Long Short-Term Memory and Quantum Gated Recurrent Unit integrated with Variational Quantum Circuits in modeling complex dynamical systems, including the Van der Pol oscillator, coupled oscillators, and the Lorenz system. We implement these advanced quantum machine learning techniques and compare their performance with traditional Long Short-Term Memory and Gated Recurrent Unit models. The results of our study reveal that the quantum-based models deliver superior precision and more stable loss metrics throughout 100 epochs for both the Van der Pol oscillator and coupled harmonic oscillators, and 20 epochs for the Lorenz system. The Quantum Gated Recurrent Unit outperforms competing models, showcasing notable performance metrics. For the Van der Pol oscillator, it reports MAE 0.0902 and RMSE 0.1031 for variable x and MAE 0.1500 and RMSE 0.1943 for y; for coupled oscillators, Oscillator 1 shows MAE 0.2411 and RMSE 0.2701 and Oscillator 2 MAE is 0.0482 and RMSE 0.0602; and for the Lorenz system, the results are MAE 0.4864 and RMSE 0.4971 for x, MAE 0.4723 and RMSE 0.4846 for y, and MAE 0.4555 and RMSE 0.4745 for z. These outcomes mark a significant advancement in the field of quantum machine learning.

AlgorithmsApr 19, 202410 citations

Reservoir Computing via Quantum Recurrent Neural Networks

Samuel Yen-Chi Chen, Daniel Fry, Deshmukh, Amol +2 more

Recent developments in quantum computing and machine learning have propelled the interdisciplinary study of quantum machine learning. Sequential modeling is an important task with high scientific and commercial value. Existing VQC or QNN-based methods require significant computational resources to perform the gradient-based optimization of a larger number of quantum circuit parameters. The major drawback is that such quantum gradient calculation requires a large amount of circuit evaluation, posing challenges in current near-term quantum hardware and simulation software. In this work, we approach sequential modeling by applying a reservoir computing (RC) framework to quantum recurrent neural networks (QRNN-RC) that are based on classical RNN, LSTM and GRU. The main idea to this RC approach is that the QRNN with randomly initialized weights is treated as a dynamical system and only the final classical linear layer is trained. Our numerical simulations show that the QRNN-RC can reach results comparable to fully trained QRNN models for several function approximation and time series prediction tasks. Since the QRNN training complexity is significantly reduced, the proposed model trains notably faster. In this work we also compare to corresponding classical RNN-based RC implementations and show that the quantum version learns faster by requiring fewer training epochs in most cases. Our results demonstrate a new possibility to utilize quantum neural network for sequential modeling with greater quantum hardware efficiency, an important design consideration for noisy intermediate-scale quantum (NISQ) computers.

arXiv:2211.02612Nov 4, 20229 citations