Algorithms

Quantum Recurrent Neural Networks: Predicting the Dynamics of Oscillatory and Chaotic Systems

Yuan Chen, Abdul Q. M. Khaliq

Published Apr 19, 2024• 10 citations

Abstract

In this study, we investigate Quantum Long Short-Term Memory and Quantum Gated Recurrent Unit integrated with Variational Quantum Circuits in modeling complex dynamical systems, including the Van der Pol oscillator, coupled oscillators, and the Lorenz system. We implement these advanced quantum machine learning techniques and compare their performance with traditional Long Short-Term Memory and Gated Recurrent Unit models. The results of our study reveal that the quantum-based models deliver superior precision and more stable loss metrics throughout 100 epochs for both the Van der Pol oscillator and coupled harmonic oscillators, and 20 epochs for the Lorenz system. The Quantum Gated Recurrent Unit outperforms competing models, showcasing notable performance metrics. For the Van der Pol oscillator, it reports MAE 0.0902 and RMSE 0.1031 for variable x and MAE 0.1500 and RMSE 0.1943 for y; for coupled oscillators, Oscillator 1 shows MAE 0.2411 and RMSE 0.2701 and Oscillator 2 MAE is 0.0482 and RMSE 0.0602; and for the Lorenz system, the results are MAE 0.4864 and RMSE 0.4971 for x, MAE 0.4723 and RMSE 0.4846 for y, and MAE 0.4555 and RMSE 0.4745 for z. These outcomes mark a significant advancement in the field of quantum machine learning.

DOI: 10.3390/a17040163

Related papers

A variational approach to quantum gated recurrent units

Andrea Ceschini, Antonello Rosato, Massimo Panella

Abstract Quantum Recurrent Neural Networks are receiving an increased attention thanks to their enhanced generalization capabilities in time series analysis. However, their performances were bottlenecked by long training times and unscalable architectures. In this paper, we propose a novel Quantum Recurrent Neural Network model based on Quantum Gated Recurrent Units. It uses a learnable Variational Quantum Layer to process temporal data, interspersed with two classical layers to properly match the dimensionality of the input and output vectors. Such an architecture has fewer quantum parameters than existing Quantum Long Short-Term Memory models. Both the quantum networks were evaluated on periodic and real-world time series datasets, together with the classical counterparts. The quantum models exhibited superior performances compared to the classical ones in all the test cases. The Quantum Gated Recurrent Units outperformed the Quantum Long Short-Term Memory network despite having a simpler internal configuration. Moreover, the Quantum Gated Recurrent Units network demonstrated to be about 25% faster during the training and inference procedure over the Quantum Long Short-Term Memory. This improvement in speed comes with one less quantum circuit to be executed, suggesting that our model may offer a more efficient alternative for implementing Quantum Recurrent Neural Networks on both simulated and real quantum hardware.

Journal of Physics CommunicationsAug 1, 202410 citations

Hybrid Classical–Quantum Surrogate Modeling for Nonlinear Reactor Dynamics: A Comparative Study of GRU, LSTM, Transformer, and Variational Quantum Circuits

Kameswari Mantha

This preprint presents a comparative study of classical recurrent neural networks and hybrid quantum-classical models for surrogate modeling of nonlinear dynamical systems. A synthetic reactor dataset exhibiting coupled multi-frequency behavior is used to evaluate GRU, LSTM, Transformer, and Variational Quantum Circuit (VQC) architectures under identical training conditions. Model performance is assessed using RMSE, MAE, and R² metrics. Results show that recurrent architectures outperform both Transformer and VQC approaches on this task, highlighting the effectiveness of memory-based models for nonlinear time-series prediction and the current limitations of near-term quantum machine learning methods in complex regression settings. The study provides insights into the applicability of hybrid quantum-classical approaches for scientific surrogate modeling and time-series forecasting.

Jun 2, 20260 citations

Quantum-Enhanced Recurrent Neural Networks via Variational Quantum Gating for Battery State of Health Prediction

Yin Xu, Qinglin Liu, Li Gao +1 more

Accurate state-of-health (SOH) estimation for lithium-ion batteries remains a challenging problem due to complex electrochemical degradation mechanisms and long-range temporal dependencies. In this work, we propose a quantum-enhanced recurrent framework, termed QLSTM, in which variational quantum circuits are directly embedded into the gating mechanisms of long short-term memory networks. By replacing classical affine transformations with parameterized unitary operations, the proposed model introduces structured nonlinear transformations into the recurrent state-transition process. Extensive experiments on multiple benchmark battery datasets demonstrate that QLSTM consistently outperforms classical sequence models in both predictive accuracy and robustness, achieving significant reductions in mean absolute error (MAE), with improvements on the order of 20% compared with classical LSTM baselines. Ablation studies further confirm that these improvements arise primarily from quantum-enhanced gating rather than input-level transformations. Additional analyses on qubit scaling and noise robustness reveal that model performance is governed by a balance between expressive capacity and trainability. These results provide empirical evidence that embedding quantum computational primitives within recurrent architectures offers a structurally grounded approach to improving sequence modeling capability. The proposed framework establishes a new design paradigm for integrating quantum operators into temporal learning models, with potential applications in complex dynamical system prediction tasks.

quant-pharXiv:2604.20438Apr 23, 20260 citations

Quantum Recurrent Neural Networks with Encoder-Decoder for Time-Dependent Partial Differential Equations

Yuan Chen, Abdul Q. M. Khaliq, Khaled M. Furati

Nonlinear time-dependent partial differential equations are essential in modeling complex phenomena across diverse fields, yet they pose significant challenges due to their computational complexity, especially in higher dimensions. This study explores Quantum Recurrent Neural Networks within an encoder-decoder framework, integrating Variational Quantum Circuits into Gated Recurrent Units and Long Short-Term Memory networks. Using this architecture, the model efficiently compresses high-dimensional spatiotemporal data into a compact latent space, facilitating more efficient temporal evolution. We evaluate the algorithms on the Hamilton-Jacobi-Bellman equation, Burgers' equation, the Gray-Scott reaction-diffusion system, and the three dimensional Michaelis-Menten reaction-diffusion equation. The results demonstrate the superior performance of the quantum-based algorithms in capturing nonlinear dynamics, handling high-dimensional spaces, and providing stable solutions, highlighting their potential as an innovative tool in solving challenging and complex systems.

arXiv:2502.13370Feb 19, 20250 citations

Machine learning of chaotic characteristics in classical nonlinear dynamics using variational quantum circuit

Sheng-Chen Bai, Shi-Ju Ran

Abstract Replicating the chaotic characteristics inherent in nonlinear dynamical systems via machine learning (ML) is a key challenge in this rapidly advancing interdisciplinary field. In this work, we explore the potential of variational quantum circuits (VQC) for learning the stochastic properties of classical nonlinear dynamical systems. Specifically, we focus on the one- and two-dimensional logistic maps, which, while simple, remain under-explored in the context of learning dynamical characteristics. Our findings reveal that, even for such simple dynamical systems, accurately replicating long-term characteristics is hindered by a pronounced sensitivity to overfitting. While increasing the parameter complexity of the ML model typically enhances short-term prediction accuracy, it also leads to a degradation in the model’s ability to replicate long-term characteristics, primarily due to the detrimental effects of overfitting on generalization power. By comparing the VQC with two widely recognized classical ML techniques, which are long short-term memory (LSTM) networks for time-series processing and reservoir computing, we demonstrate that VQC outperforms these methods in terms of replicating long-term characteristics. Our results suggest that for the ML of dynamics, it is demanded to develop more compact and efficient models (such as VQC) rather than more complicated and large-scale ones.

Chinese Physics BJul 3, 20250 citations

Predicting quantum many-body dynamics with Long Short-Term Memory based neural networks

Zewang Zhang, Shuo Yang, Chenxi Liu +5 more

Machine learning (ML) architectures such as convolutional neural networks (CNNs) have garnered considerable recent attention in the study of quantum many-body systems. However, advanced ML approaches such as gated recurrent neural networks (RNNs) have seldom been applied to such contexts. Here we demonstrate that a special class of RNNs known as long short-term memory (LSTM) networks is capable of learning and accurately predicting the time evolution of one-dimensional (1D) Ising model with simultaneous transverse and parallel magnetic fields, as quantitatively corroborated by relative entropy measurements and magnetization between the predicted and exact state distributions. In this unsupervised learning task, the many-body state evolution was predicted in an autoregressive way from an initial state, without any guidance or knowledge of any Hamiltonian. Our work paves the way for future applications of advanced ML methods in quantum many-body dynamics without relying on the explicit form of the Hamiltonian.

May 22, 20190 citations