Hybrid Classical-Quantum Deep Learning Models for Autonomous Vehicle Traffic Image Classification Under Adversarial Attack
Reek Majumder, Sakib Mahmud Khan, Fahim Ahmed, Zadid Khan, FRANK CHARLES NGENI, Gurcan Comert, Judith Mwakalonge, Dimitra Michalaka, Mashrur A. Chowdhury
Image classification must work for autonomous vehicles (AV) operating on public roads, and actions performed based on image misclassification can have serious consequences. Traffic sign images can be misclassified by an adversarial attack on machine learning models used by AVs for traffic sign recognition. To make classification models resilient against adversarial attacks, we used a hybrid deep-learning model with both the quantum and classical layers. Our goal is to study the hybrid deep-learning architecture for classical-quantum transfer learning models to support the current era of intermediate-scale quantum technology. We have evaluated the impacts of various white box adversarial attacks on these hybrid models. The classical part of hybrid models includes a convolution network from the pre-trained Resnet18 model, which extracts informative features from a high dimensional LISA traffic sign image dataset. The output from the classical processor is processed further through the quantum layer, which is composed of various quantum gates and provides support to various quantum mechanical features like entanglement and superposition. We have tested multiple combinations of quantum circuits to provide better classification accuracy with decreasing training data and found better resiliency for our hybrid classical-quantum deep learning model during attacks compared to the classical-only machine learning models.
Image classification must work for autonomous vehicles (AV) operating on public roads, and actions performed based on image misclassification can have serious consequences. Traffic sign images can be misclassified by an adversarial attack on machine learning models used by AVs for traffic sign recognition. To make classification models resilient against adversarial attacks, we used a hybrid deep-learning model with both the quantum and classical layers. Our goal is to study the hybrid deep-learning architecture for classical-quantum transfer learning models to support the current era of intermediate-scale quantum technology. We have evaluated the impacts of various white box adversarial attacks on these hybrid models. The classical part of hybrid models includes a convolution network from the pre-trained Resnet18 model, which extracts informative features from a high dimensional LISA traffic sign image dataset. The output from the classical processor is processed further through the quantum layer, which is composed of various quantum gates and provides support to various quantum mechanical features like entanglement and superposition. We have tested multiple combinations of quantum circuits to provide better classification accuracy with decreasing training data and found better resiliency for our hybrid classical-quantum deep learning model during attacks compared to the classical-only machine learning models.
With millions of medical data being produced daily, it is important to leverage current technology to improve the healthcare system. As traditional deep learning models are unable to effectively handle high-dimensional data, a hybrid classical-quantum approach is used to enhance traditional deep learning algorithms. The hybrid classical-quantum models are built upon the classical deep learning framework with quantum techniques. The classical layers are utilized for feature extraction while the quantum layer is used for computational tasks. This addresses computational limitations and data imbalance challenges in medical image analysis. Transfer learning models, such as ResNet18 and InceptionV3, are used in conjunction with a quantum variational circuit to perform the task. The model is trained on a chest X-ray dataset, which consists of two sets of data: binary and multiclass. The binary dataset consists of Normal and COVID-19 images, while the multiclass dataset has COVID-19, Normal, and Tuberculosis images for classification. PennyLane, as a simulator, has been used to perform quantum computing. The dataset has also been used to train the traditional transfer learning models, pre-trained ResNet18, and their results have been compared. Out of all the models tested, the hybrid classical-quantum model, namely Hybrid ResNet18, performed the best. It achieved an accuracy of 93.22% for the binary classification task and 93.91% for the multiclass classification. The results show that there is a statistically significant improvement in classification accuracy and F1-score of the hybrid approach over the classical transfer learning baselines under a simulation-based environment. This sets the stage for further research on real-world physical quantum hardware. Class imbalance and overlapping predictions have been addressed using methods such as data augmentation and confusion matrix analysis. Thus, quantum machine learning could be used as a vital tool to analyze medical data for better diagnostic results.
In this work, we investigate the performance of hybrid quantum-classical convolutional neural networks (QCNNs) in medical image classification under the presence of adversarial attacks. Adversarial attacks pose a significant threat to image classification models, since they introduce subtle perturbations to input images, leading to incorrect predictions. Specifically, in this work, 10 QCNNs with their corresponding classic Convolutional Neural Networks (CNNs) counterparts are comparatively examined for their robustness, on two different medical image datasets using transfer learning, under two different adversarial attacks. In a subsequent step, the implementation of training models from scratch is also evaluated. With transfer learning on the X-ray dataset, CNN and QCNN models achieve high and comparable performance across most backbones. On the histopathological dataset, CNNs and QCNNs often generalize worse compared to the X-ray dataset, indicating head overfitting under domain shift. The adversarial evaluation results highlight that most models' robustness comes from the backbone rather than the head. QCNN models perform comparably to CNNs under attack and show improvements when trained from scratch. Overall, the results indicate that integrating quantum circuit mechanisms into classical CNN architectures can enhance the robustness of models in medical imaging tasks, representing a promising domain that warrants further investigation.
The integration of quantum computing principles with classical deep learning architectures has emerged as a promising direction for advancing image recognition systems beyond the limitations of purely classical convolutional neural networks (CNNs). This study proposes and analyzes a hybrid quantum–classical deep learning framework based on quanvolutional neural network (QNN) principles, where quantum circuits are embedded within convolutional feature extraction layers to enhance representation capability. The research investigates how quantum-enhanced filters, particularly quanvolutional layers, contribute to improved feature diversity, non-linear transformation capacity, and classification accuracy in image recognition tasks. Building upon established convolutional architectures and quantum machine learning theories, the proposed framework integrates quantum random circuit encoding with classical deep neural networks to evaluate performance gains in comparison to conventional CNN models. The study further incorporates theoretical insights from hybrid quantum-classical learning systems, emphasizing the role of parameterized quantum circuits in feature mapping and optimization stability. The methodology is grounded in NISQ-era quantum computing constraints and leverages hybrid optimization strategies to ensure computational feasibility. Experimental evaluation demonstrates that quanvolution-based models can provide improved robustness in feature extraction, particularly in high-dimensional image spaces, while maintaining competitive computational efficiency. However, scalability limitations and noise sensitivity in quantum circuits remain key challenges. Overall, this work contributes to the growing field of quantum-enhanced machine learning by providing a structured performance analysis of hybrid quanvolutional architectures and highlighting their potential role in next-generation intelligent visual recognition systems.
Image classification has become a fundamental task in computer vision with applications in areas such as medical imaging, agriculture, environmental monitoring, and automated surveillance. Traditional machine learning techniques have achieved reasonable performance in classification tasks; however, they often struggle when dealing with high-dimensional and complex image datasets. Deep learning models, particularly Convolutional Neural Networks (CNNs), have significantly improved image classification performance by automatically learning hierarchical feature representations. Despite these advancements, classical deep learning models may still face challenges related to computational complexity and large-scale data processing.In recent years, quantum machine learning has emerged as a promising paradigm that combines principles of quantum computing with classical machine learning techniques to enhance computational efficiency and model performance. This study proposes a hybrid quantum–classical framework for image classification that integrates a deep residual network (ResNet-50) with a Quantum Support Vector Machine (QSVM). The ResNet-50 model is employed as a feature extraction mechanism to capture high-level visual representations from image data. The extracted features are then reduced in dimensionality using Principal Component Analysis (PCA) to simplify the feature space and improve computational efficiency.The reduced feature vectors are subsequently classified using a QSVM model that utilizes quantum feature maps to encode classical data into quantum states. Various quantum feature maps are explored to evaluate their impact on classification performance. Experimental results demonstrate that the hybrid quantum–classical approach achieves higher classification accuracy compared to conventional machine learning models such as Support Vector Machines and Random Forest classifiers. The proposed framework highlights the potential of combining classical deep learning architectures with quantum machine learning algorithms to address complex image classification challenges. This hybrid approach provides an efficient and scalable solution for advanced image analysis tasks and demonstrates the growing potential of quantum computing in artificial intelligence applications.
We extend the concept of transfer learning, widely applied in modern machine learning algorithms, to the emerging context of hybrid neural networks composed of classical and quantum elements. We propose different implementations of hybrid transfer learning, but we focus mainly on the paradigm in which a pre-trained classical network is modified and augmented by a final variational quantum circuit. This approach is particularly attractive in the current era of intermediate-scale quantum technology since it allows to optimally pre-process high dimensional data (e.g., images) with any state-of-the-art classical network and to embed a select set of highly informative features into a quantum processor. We present several proof-of-concept examples of the convenient application of quantum transfer learning for image recognition and quantum state classification. We use the cross-platform software library PennyLane to experimentally test a high-resolution image classifier with two different quantum computers, respectively provided by IBM and Rigetti.
Given the recent prominence of Noisy Intermediate Scale Quantum (NISQ) devices, hybrid quantum-classical neural networks have recently drawn a lot of excitement as a potential solution to improving learning efficiency. Our current paper describes a Hybrid Quantum-Classical Convolutional Neural Network (HQCNN) which is defined as a pretrained backbone of ResNet-18 and a small quantum-enhanced feature-transformation layer of Qiskit. The convolutional high-dimensional features are reduced to the classical eight-dimensional one, which in turn is encoded into a four-qubit parameterized quantum circuit. The resultant quantum expectation values are combined with the compressed features to come up with a hybridized representation of twelve dimensions, used to classify multi-class dataset. Experimental analysis of CIFAR10 data has shown that the suggested HQCNN achieves a test accuracy of 94.74% and improves class-wise precision, recall, and F1-scores than a number of existing hybrid models while using a significantly smaller number of latent features. More investigation into the quantum module indicates that it is predictable about scalability to batch, resistant to perturbations in features, and efficiently performed by evaluating circuit vectors. These results indicate that compact and expressive representations of images that can be helpful in the NISQ era can be acquired using hybrid architectures, thus providing a practical way to forward the benefits of quantum to modern deep-learning pipelines.