arXiv:2411.13225 · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)

Quantum Kernel-Based Long Short-term Memory

Yu-Chao Hsu, Tai-Yu Li, Kuan‐Cheng Chen

Published Apr 6, 2025• 15 citations

Abstract

The integration of quantum computing into classical machine learning architectures has emerged as a promising approach to enhance model efficiency and computational capacity. In this work, we introduce the Quantum Kernel-Based Long Short-Term Memory (QK-LSTM) network, which utilizes quantum kernel functions within the classical LSTM framework to capture complex, non-linear patterns in sequential data. By embedding input data into a high-dimensional quantum feature space, the QK-LSTM model reduces the reliance on large parameter sets, achieving effective compression while maintaining accuracy in sequence modeling tasks. This quantum-enhanced architecture demonstrates efficient convergence, robust loss minimization, and model compactness, making it suitable for deployment in edge computing environments and resource-limited quantum devices (especially in the NISQ era). Benchmark comparisons reveal that QK-LSTM achieves performance on par with classical LSTM models, yet with fewer parameters, underscoring its potential to advance quantum machine learning applications in natural language processing and other domains requiring efficient temporal data processing.

DOI: 10.1109/icasspw65056.2025.11011010

Related papers

Quantum Kernel-Based Long Short-term Memory for Climate Time-Series Forecasting

Yu-Chao Hsu, Nan-Yow Chen, Tai-Yu Li +2 more

We present the Quantum Kernel-Based Long Short-Term Memory (QK-LSTM) network, which integrates quantum kernel methods into classical LSTM architectures to enhance predictive accuracy and computational efficiency in climate time-series forecasting tasks, such as Air Quality Index (AQI) prediction. By embedding classical inputs into high-dimensional quantum feature spaces, QK-LSTM captures intricate nonlinear dependencies and temporal dynamics with fewer trainable parameters. Leveraging quantum kernel methods allows for efficient computation of inner products in quantum spaces, addressing the computational challenges faced by classical models and variational quantum circuit-based models. Designed for the Noisy Intermediate-Scale Quantum (NISQ) era, QK-LSTM supports scalable hybrid quantum-classical implementations. Experimental results demonstrate that QK-LSTM outperforms classical LSTM networks in AQI forecasting, showcasing its potential for environmental monitoring and resource-constrained scenarios, while highlighting the broader applicability of quantum-enhanced machine learning frameworks in tackling large-scale, high-dimensional climate datasets.

arXiv:2412.08851International Conference on Quantum Communications, Networking, and Computing (QCNC)Mar 31, 202518 citations

Quantum Long Short-Term Memory for Sequence Prediction

Belkacem Chikhaoui

Quantum machine learning (QML) offers new perspectives for modeling complex sequential data by leveraging the computational advantages of quantum computing. In this work, we explore the application of Quantum Long Short-Term Memory (QLSTM) networks for sequence prediction tasks. By integrating parameterized quantum circuits within the classical LSTM architecture, QLSTM models exploit quantum parallelism and entanglement to learn temporal dependencies in data more efficiently. We evaluate the performance of QLSTM on synthetic and real-world sequence prediction tasks and compare it with its classical counterpart. The results demonstrate that QLSTM models achieve competitive performance with fewer trainable parameters, indicating their potential as lightweight and efficient models for sequence learning and prediction.

IEEE/ACS International Conference on Computer Systems and Applications (AICCSA)Oct 19, 20250 citations

Quantum Long Short-Term Memory

Samuel Yen-Chi Chen, Shinjae Yoo, Yao-Lung L. Fang

Long short-term memory (LSTM) is a kind of recurrent neural networks (RNN) for sequence and temporal dependency data modeling and its effectiveness has been extensively established. In this work, we propose a hybrid quantum-classical model of LSTM, which we dub QLSTM. We demonstrate that the proposed model successfully learns several kinds of temporal data. In particular, we show that for certain testing cases, this quantum version of LSTM converges faster, or equivalently, reaches a better accuracy, than its classical counterpart. Due to the variational nature of our approach, the requirements on qubit counts and circuit depth are eased, and our work thus paves the way toward implementing machine learning algorithms for sequence modeling such as natural language processing, speech recognition on noisy intermediate-scale quantum (NISQ) devices.

IEEE International Conference on Acoustics Speech and Signal ProcessingApr 27, 2022256 citations

Quantum Long Short-Term Memory for Drug Discovery

Liang Zhang, Yin Xu, Mohan Wu +2 more

Quantum computing combined with machine learning (ML) is a highly promising research area, with numerous studies demonstrating that quantum machine learning (QML) is expected to solve scientific problems more effectively than classical ML. In this work, we present Quantum Long Short-Term Memory (QLSTM), a QML architecture, and demonstrate its effectiveness in drug discovery. We evaluate QLSTM on five benchmark datasets (BBBP, BACE, SIDER, BCAP37, T-47D), and observe consistent performance gains over classical LSTM, with ROC-AUC improvements ranging from 3% to over 6%. Furthermore, QLSTM exhibits improved predictive accuracy as the number of qubits increases, and faster convergence than classical LSTM under the same training conditions. Notably, QLSTM maintains strong robustness against quantum computer noise, outperforming noise-free classical LSTM in certain settings. These findings highlight the potential of QLSTM as a scalable and noise-resilient model for scientific applications, particularly as quantum hardware continues to advance in qubit capacity and fidelity.

arXiv:2407.19852Jul 29, 20241 citation

Federated Quantum Kernel-Based Long Short-Term Memory for Human Activity Recognition

Yu-Chao Hsu, Jiun-Cheng Jiang, Chun-Hua Lin +5 more

In this work, we introduce the Federated Quantum Kernel-Based Long Short-term Memory (Fed-QK-LSTM) framework, integrating the quantum kernel methods and Long Shortterm Memory into federated learning. Within Fed-QK-LSTM framework, we enhance human activity recognition (HAR) in privacy-sensitive environments and leverage quantum computing for distributed learning systems. The DeepConv-QK-LSTM architecture on each client node employs convolutional layers for efficient local pattern capture, this design enables the use of a shallow QK-LSTM to model long-range relationships within the HAR data. The quantum kernel method enables the model to capture complex non-linear relationships in multivariate time-series data with fewer trainable parameters. Experimental results on RealWorld HAR dataset demonstrate that Fed-QK-LSTM framework achieves competitive accuracy across different client settings and local training rounds. We showcase the potential of Fed-QK-LSTM framework for robust and privacy-preserving human activity recognition in real-world applications, especially in edge computing environments and on scarce quantum devices.

arXiv:2508.06078IEEE International Conference on Quantum Computing and Engineering (QCE)Aug 30, 20253 citations

Quantum Convolutional Long Short-Term Memory Based on Variational Quantum Algorithms in the Era of NISQ

Zeyu Xu, Wenbin Yu, Chengjun Zhang +1 more

In the era of noisy intermediate-scale quantum (NISQ) computing, the synergistic collaboration between quantum and classical computing models has emerged as a promising solution for tackling complex computational challenges. Long short-term memory (LSTM), as a popular network for modeling sequential data, has been widely acknowledged for its effectiveness. However, with the increasing demand for data and spatial feature extraction, the training cost of LSTM exhibits exponential growth. In this study, we propose the quantum convolutional long short-term memory (QConvLSTM) model. By ingeniously integrating classical convolutional LSTM (ConvLSTM) networks and quantum variational algorithms, we leverage the variational quantum properties and the accelerating characteristics of quantum states to optimize the model training process. Experimental validation demonstrates that, compared to various LSTM variants, our proposed QConvLSTM model outperforms in terms of performance. Additionally, we adopt a hierarchical tree-like circuit design philosophy to enhance the model’s parallel computing capabilities while reducing dependence on quantum bit counts and circuit depth. Moreover, the inherent noise resilience in variational quantum algorithms makes this model more suitable for spatiotemporal sequence modeling tasks on NISQ devices.

InformationMar 22, 202412 citations