Proceedings of the AAAI Symposium Series

A Hybrid Classical-Quantum Fined Tuned BERT for Text Classification

Abu Kaisar Mohammad Masum, Naveed Mahmud, M. Hassan Najafi, Sercan Aygun

Published Nov 23, 2025• 2 citations

Abstract

Fine-tuning BERT for text classification can be computationally challenging and requires careful hyper-parameter tuning. Recent studies have highlighted the potential of quantum algorithms to outperform conventional methods in machine learning and text classification tasks. In this work, we propose a hybrid approach that integrates an n-qubit quantum circuit with a classical BERT model for text classification. We evaluate the performance of the fine-tuned classical-quantum BERT and demonstrate its feasibility as well as its potential in advancing this research area. Our experimental results show that the proposed hybrid model achieves performance that is competitive with, and in some cases better than, the classical baselines on standard benchmark datasets. Furthermore, our approach demonstrates the adaptability of classical–quantum models for fine-tuning pre-trained models across diverse datasets. Overall, the hybrid model highlights the promise of quantum computing in achieving improved performance for text classification tasks.

DOI: 10.1609/aaaiss.v7i1.36908

Related papers

A Hybrid Classical-Quantum Fine Tuned BERT for Text Classification

Abu Kaisar Mohammad Masum, Naveed Mahmud, M. Hassan Najafi +1 more

Fine-tuning BERT for text classification can be computationally challenging and requires careful hyper-parameter tuning. Recent studies have highlighted the potential of quantum algorithms to outperform conventional methods in machine learning and text classification tasks. In this work, we propose a hybrid approach that integrates an n-qubit quantum circuit with a classical BERT model for text classification. We evaluate the performance of the fine-tuned classical-quantum BERT and demonstrate its feasibility as well as its potential in advancing this research area. Our experimental results show that the proposed hybrid model achieves performance that is competitive with, and in some cases better than, the classical baselines on standard benchmark datasets. Furthermore, our approach demonstrates the adaptability of classical-quantum models for fine-tuning pre-trained models across diverse datasets. Overall, the hybrid model highlights the promise of quantum computing in achieving improved performance for text classification tasks.

cs.LGCross-listedarXiv:2511.17677Nov 24, 20250 citations

When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing

Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen +2 more

The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. In particular, our proposed hybrid classical-quantum model consists of a novel random quantum temporal convolution (QTC) learning framework replacing some layers in the BERT-based decoder. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets. Particularly, the BERT-QTC boosts the performance of the existing quantum circuit-based language model in two text classification datasets by 1.57% and 1.52% relative improvements. Furthermore, BERT-QTC can be feasibly deployed on both existing commercial-accessible quantum computation hardware and CPU-based interface for ensuring data isolation.

IEEE International Conference on Acoustics Speech and Signal ProcessingApr 27, 202264 citations

Hybrid classical-quantum transfer learning for text classification

Ebrahim Ardeshir-Larijani, Mohammad Mahdi Nasiri Fatmehsari

Abstract Quantum Machine Learning (QML) is a promising field that combines the power of quantum computing with machine learning. Variational quantum circuits, where parameters of circuits are learned classically, have been widely used in many recent applications of QML. This is an instance of a hybrid quantum-classical framework, where both classical and quantum components are present. However, applying these techniques to applications involving massive data is a challenging task. One way to overcome this, is using the concept of classical-quantum transfer learning with the help of dressed quantum circuit, introduced recently, where the underlying neural architecture is pre-trained classically, but at the final steps (decision layer), a quantum circuit is used, followed by quantum measurements and post-processing to classify images with high precision. In this paper, we applied hybrid classical-quantum transfer learning to another task of massive data processing, i.e. Natural Language Processing (NLP). We show how to (binary) classify short texts (e.g., SMS) with classical-quantum transfer learning, which was originally applied to image processing only. Our quantum network was pre-trained by Bidirectional Encoder Representations from the Transformers (BERT) model, and its variational quantum circuit is fine-tuned for text processing. We evaluated the performance of our hybrid neural architecture using the Receiver Operating Characteristic (ROC) curve, which is typically used in the evaluation of classification problems. The results indicate high precision as well as lower loss function. To our knowledge, our work is the first application of quantum transfer learning to the area of NLP. Finally a comparison with a tool that uses learning but in a different way than transfer learning is presented

Quantum Machine IntelligenceMar 17, 202423 citations

When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing

Chao-Han Huck Yang, Qi, Jun, Samuel Yen-Chi Chen +2 more

arXiv:2203.03550Feb 17, 20220 citations

Quantum Natural Language Processing Using Hybrid AI Algorithms: A Variational Quantum–Classical Framework for Efficient Text Classification

P. Anitha

Quantum Natural Language Processing (QNLP) represents a novel interdisciplinaryparadigm that integrates Quantum Computing with Natural Language Processing toenhance semantic modeling and computational efficiency. Despite the remarkable successof transformer-based architectures such as BERT and GPT, classical NLP systems requirelarge-scale computational resources and extensive parameter tuning. This paper proposesa hybrid quantum–classical architecture employing parameterized quantum circuits (PQCs)integrated with classical embedding layers for text classification tasks. The frameworkutilizes classical preprocessing, quantum state encoding, variational optimization, andclassical post-measurement classification. Experimental results on benchmark sentimentanalysis datasets demonstrate competitive accuracy with significantly reduced parametercomplexity. The findings indicate that hybrid QNLP models provide enhanced semanticcompositionality and efficient representation in Hilbert space while remaining feasiblewithin Noisy Intermediate-Scale Quantum (NISQ) constraints

International Journal For Multidisciplinary ResearchMar 4, 20260 citations

Enhancing Text Classification Through Quantum Transfer Learning: A Hybrid Quantum-Classical Approach With Complex Kernel Self-Attention Networks

Xiaoxiao Chen, Xiaoping Lou

Quantum computing, with its unique principles such as superposition and entanglement, promises to transform various domains, including artificial intelligence. This study investigates the fusion of quantum computing with contemporary AI technologies through quantum transfer learning. We introduce the Complex Quantum Kernel Self-Attention Network (CQKSAN), a novel model that leverages quantum circuits and self-attention mechanisms to boost text classification performance. By applying quantum transfer learning, CQKSAN harnesses the strengths of pre-trained classical models and enhances them with quantum capabilities. Experimental results on multiple binary classification datasets demonstrate that CQKSAN achieves a more efficient learning process. Specifically, it improves training accuracy and validation accuracy by up to 24.31% and 28.35%, respectively, and increases the Matthews Correlation Coefficient by 113.10%. Moreover, CQKSAN consistently outperforms the BERT baseline in both training and validation accuracy across various datasets, showcasing its strong learning capability and generalization performance in handling tasks with diverse linguistic structures and complex semantics. Our findings underscore the potential of hybrid quantum-classical approaches, while also identifying the current limitations and paving the way for future research in fully quantum-based learning systems.

IEEE AccessJan 1, 20255 citations