The rapid advancement of machine learning (ML) and the growing need for computational power have led to the exploration of quantum computing, which offers significant potential for faster complex calculations. However, Quantum Machine Learning (QML) faces challenges due to the limited number of qubits and noise of quantum circuits, particularly with Noisy Intermediate-Scale Quantum (NISQ) devices. These challenges severely limit the current capacity to train accurate and stable Quantum Machine Learning Models. In this paper, we propose a novel framework for QML that employs the knowledge distillation method to harness the power of well-trained classical machine learning (CML) models and enhance the training performance of QML models. In this framework, we utilize the well-trained CML as a teacher model to assist the training of the student QML model using the knowledge distillation method. By distilling knowledge from the robust CML model, our framework can potentially address the problem of the barren plateau which hinders effective model training. Knowledge distillation is well suited for this framework through the transfer of knowledge without parameter sharing. Through empirical tests, our framework has demonstrated not only an increase in the accuracy of QML models but also a notable improvement in training stability.
The rapid advancement of machine learning (ML) and the growing need for computational power have led to the exploration of quantum computing, which offers significant potential for faster complex calculations. However, Quantum Machine Learning (QML) faces challenges due to the limited number of qubits and noise of quantum circuits, particularly with Noisy Intermediate-Scale Quantum (NISQ) devices. These challenges severely limit the current capacity to train accurate and stable Quantum Machine Learning Models. In this paper, we propose a novel framework for QML that employs the knowledge distillation method to harness the power of well-trained classical machine learning (CML) models and enhance the training performance of QML models. In this framework, we utilize the well-trained CML as a teacher model to assist the training of the student QML model using the knowledge distillation method. By distilling knowledge from the robust CML model, our framework can potentially address the problem of the barren plateau which hinders effective model training. Knowledge distillation is well suited for this framework through the transfer of knowledge without parameter sharing. Through empirical tests, our framework has demonstrated not only an increase in the accuracy of QML models but also a notable improvement in training stability.
Quantum machine learning has emerged as a promising approach to enhance computational efficiency by leveraging the principles of quantum computing. However, the limitations of current Noisy Intermediate-Scale Quantum (NISQ) devices, such as noise, limited qubit availability, and circuit depth constraints, restrict the implementation of fully quantum models. To address these challenges, this study focuses on the design, implementation, and performance evaluation of hybrid quantum-classical machine learning (HQML) models. The proposed approach integrates parameterized quantum circuits with classical optimization techniques to enable efficient learning within NISQ environments. The study employs standard benchmark datasets, including Iris, Breast Cancer, and MNIST, to evaluate the performance of the hybrid model. The results indicate that the HQML model achieves competitive accuracy on small and medium-sized datasets while maintaining balanced precision, recall, and F1-score. However, performance declines for complex datasets due to hardware limitations and noise effects. Additionally, the hybrid model demonstrates a lower number of parameters compared to classical deep learning models but requires higher training time due to iterative quantum-classical optimization. The findings highlight that hybrid quantum-classical models provide a practical and scalable approach for utilizing quantum computing in the current technological landscape. Although challenges related to noise, scalability, and computational overhead persist, advancements in quantum hardware and algorithm design are expected to improve performance. This study contributes to the growing field of quantum machine learning by providing a systematic framework for evaluating hybrid models on NISQ devices and identifying key areas for future research.
While Quantum Neural Networks (QNNs) offer the potential for resource-efficient image classification, practical implementations are hindered by qubit instability and finite availability, causing them to often underperform classical counterparts. This performance disparity constitutes a critical research gap. We propose a novel hybrid classical-quantum knowledge distillation approach to bridge this gap. Our method utilizes a pre-trained classical CNN (AlexNet) as a teacher to guide the training of a quantum student model by minimizing the Kullback-Leibler (KL) divergence (DKL) between their output distributions. The quantum student model employs an architecture designed to facilitate intricate feature interactions using iterated CNOT gates. This technique substantially improves quantum model accuracy, demonstrating gains of 0.34% (6-class, 3 qubits) and 0.28% (8-class, 3 qubits) on the MNIST dataset, and 0.74% (8-class, 4 qubits). Our contribution lies in operationalizing a knowledge distillation paradigm for applied Quantum Machine Learning (QML), enabling the effective transfer of robust knowledge from established classical architectures to resource-constrained quantum models, thereby enhancing faster convergence and accelerating practical QML deployment.
Quantum neural networks (QNNs), harnessing superposition and entanglement, have shown potential to surpass classical methods in complex learning tasks but remain limited by hardware constraints and noisy conditions. In this work, we present a novel framework for transferring knowledge from classical convolutional neural networks (CNNs) to QNNs via knowledge distillation, thereby reducing the need for resource intensive quantum training and error mitigation. We conduct extensive experiments using two parameterized quantum circuits (PQCs) with 4 and 8 qubits on MNIST, Fashion MNIST, and CIFAR10 datasets. The approach demonstrates consistent accuracy improvements attributed to distilled knowledge from larger classical networks. Through ablation studies, we systematically compare the effect of state of the art dimensionality reduction techniques fully connected layers, center cropping, principal component analysis, and pooling to compress high-dimensional image data prior to quantum encoding. Our findings reveal that fully connected layers retain the most salient features for QNN inference, thereby surpassing other down sampling approaches. Additionally, we examine state of the art data encoding methods (amplitude, angle, and qubit encoding) and identify amplitude encoding as the optimal strategy, yielding superior accuracy across all tested datasets and qubit configurations. Through computational analyses, we show that our distilled 4-qubit and 8-qubit QNNs achieve competitive performance while utilizing significantly fewer parameters than their classical counterparts. Our results establish a promising paradigm for bridging classical deep learning and emerging quantum computing, paving the way for more powerful, resource conscious models in quantum machine intelligence.
The rapid advancement of quantum computing hardware and software has ushered in a new era for computational science, promising to tackle problems that are intractable for classical computers. Parallelly, machine learning (ML) has revolutionized data analysis and artificial intelligence. The confluence of these two fields, known as Quantum Machine Learning (QML), aims to harness the principles of quantum mechanics-such as superposition, entanglement, and interference-to enhance and redefine classical machine learning algorithms. This survey provides a comprehensive overview of the burgeoning field of QML. We begin by elucidating the fundamental quantum concepts that underpin QML approaches. We then present a detailed taxonomy and analysis of prominent QML algorithms, categorizing them into quantum-enhanced classical models and fully quantum models. Key families of algorithms discussed include Quantum Support Vector Machines (QSVM), Quantum Neural Networks (QNNs), and Quantum Generative Adversarial Networks (QGANs). For each, we explain the theoretical quantum advantage, the circuit implementation, and the current limitations. Furthermore, we delve into the critical challenges facing the practical realization of QML, including the pervasive issue of noise in Noisy Intermediate-Scale Quantum (NISQ) devices, the problem of barren plateaus in training quantum circuits, and the complexities of efficient data encoding (quantum feature maps). We also present a small-scale experimental simulation of a variational quantum classifier on a standardized dataset, demonstrating its principle and comparing its performance with a classical counterpart. Finally, the paper discusses the future trajectory of QML, highlighting the importance of error mitigation, hybrid quantum-classical architectures, and the development of quantum-specific learning inductive biases. We conclude that while fault-tolerant quantum computers remain on the horizon, QML represents a paradigm shift with the potential to deliver profound computational advantages in the coming decades.
Abstract Quantum machine learning (QML) is a rapidly growing interdisciplinary field at the intersection of quantum computing and machine learning, aiming to harness the unique properties of quantum mechanics to address complex computational challenges and enhance algorithmic performance. Despite its potential, QML faces significant challenges such as computational complexity, data efficiency, and resource requirements. This paper introduces a novel transfer learning approach to improve the performance and efficiency of quantum models. By leveraging the knowledge from previously trained quantum models, our method reduces training time and enhances accuracy, making QML more practical for real-world applications. Experimental results validate the effectiveness of our approach, demonstrating substantial improvements in both accuracy and training time. PACS numbers: 03.67.Ac,03.67.Lx,03.67.Mn,03.67.Pp
Machine Learning (ML) has been widely applied across numerous domains due to its ability to automatically identify informative patterns from data for various tasks. The availability of large-scale data and advanced computational power enables the development of sophisticated models and training strategies, leading to state-of-the-art performance, but it also introduces substantial challenges. Quantum Computing (QC), which exploits quantum mechanisms for computation, has attracted growing attention and significant global investment as it may address these challenges. Consequently, Quantum Machine Learning (QML), the integration of these two fields, has received increasing interest, with a notable rise in related studies in recent years. We are motivated to review these existing contributions regarding quantum circuit-based learning models for classical data analysis and highlight the identified potentials and challenges of this technique. Specifically, we focus not only on QML models, both kernel-based and neural network-based, but also on recent explorations of their integration with classical machine learning layers within hybrid frameworks. Moreover, we examine both theoretical analysis and empirical findings to better understand their capabilities, and we also discuss the efforts on noise-resilient and hardware-efficient QML that could enhance its practicality under current hardware limitations. In addition, we cover several emerging paradigms for advanced quantum circuit design and highlight the adaptability of QML across representative application domains. This study aims to provide an overview of the contributions made to bridge quantum computing and machine learning, offering insights and guidance to support its future development and pave the way for broader adoption in the coming years.