Multimodal learning aims to enhance perceptual and decision-making capabilities by integrating information from diverse sources. However, classical deep learning approaches face a critical trade-off between the high accuracy of black-box feature-level fusion and the interpretability of less outstanding decision-level fusion, alongside the challenges of parameter explosion and complexity. This paper discusses the accuracy-interpretablity-complexity dilemma under the quantum computation framework and propose a feature entanglement-based quantum multimodal fusion neural network. The model is composed of three core components: a classical feed-forward module for unimodal processing, an interpretable quantum fusion block, and a quantum convolutional neural network (QCNN) for deep feature extraction. By leveraging the strong expressive power of quantum, we have reduced the complexity of multimodal fusion and post-processing to linear, and the fusion process also possesses the interpretability of decision-level fusion. The simulation results demonstrate that our model achieves classification accuracy comparable to classical networks with dozens of times of parameters, exhibiting notable stability and performance across multimodal image datasets.
Multimodal learning aims to enhance perceptual and decision-making capabilities by integrating information from diverse sources. However, classical deep learning approaches face a critical trade-off between the high accuracy of black-box feature-level fusion and the interpretability of less outstanding decision-level fusion, alongside the challenges of parameter explosion and complexity. This paper discusses the accuracy-interpretablity-complexity dilemma under the quantum computation framework and propose a feature entanglement-based quantum multimodal fusion neural network. The model is composed of three core components: a classical feed-forward module for unimodal processing, an interpretable quantum fusion block, and a quantum convolutional neural network (QCNN) for deep feature extraction. By leveraging the strong expressive power of quantum, we have reduced the complexity of multimodal fusion and post-processing to linear, and the fusion process also possesses the interpretability of decision-level fusion. The simulation results demonstrate that our model achieves classification accuracy comparable to classical networks with dozens of times of parameters, exhibiting notable stability and performance across multimodal image datasets.
Deep learning has achieved significant success in pattern recognition, with convolutional neural networks (CNNs) serving as a foundational architecture for extracting spatial features from images. Quantum computing provides an alternative computational framework, a hybrid quantum-classical convolutional neural networks (QCCNNs) leverage high-dimensional Hilbert spaces and entanglement to surpass classical CNNs in image classification accuracy under comparable architectures. Despite performance improvements, QCCNNs typically use fixed quantum layers without incorporating trainable quantum parameters. This limits their ability to capture non-linear quantum representations and separates the model from the potential advantages of expressive quantum learning. In this work, we present a hybrid quantum-classical-quantum convolutional neural network (QCQ-CNN) that incorporates a quantum convolutional filter, a shallow classical CNN, and a trainable variational quantum classifier. This architecture aims to enhance the expressivity of decision boundaries in image classification tasks by introducing tunable quantum parameters into the end-to-end learning process. Through a series of small-sample experiments on MNIST, F-MNIST, and MRI tumor datasets, QCQ-CNN demonstrates competitive accuracy and convergence behavior compared to classical and hybrid baselines. We further analyze the effect of ansatz depth and find that moderate-depth quantum circuits can improve learning stability without introducing excessive complexity. Additionally, simulations incorporating depolarizing noise and finite sampling shots suggest that QCQ-CNN maintains a certain degree of robustness under realistic quantum noise conditions. While our results are currently limited to simulations with small-scale quantum circuits, the proposed approach offers a potentially promising direction for hybrid quantum learning in near-term applications.
Abstract Quantum Machine Learning (QML) has emerged as a promising paradigm that leverages the principles of quantum mechanics—such as superposition and entanglement—to overcome the limitations of classical machine learning in handling complex, high-dimensional data. However, practical challenges such as limited coherence times of qubits and the integration of quantum circuits with classical architectures have hindered the full realization of QML’s potential. To address these challenges, this paper proposes a novel hybrid architecture, termed the Classical-Quantum Hybrid Convolutional Neural Network (CQHCNN), which integrates quantum-inspired layers into conventional deep learning frameworks. These quantum layers utilize quantum information processing to extract complex features, while the classical components perform feature extraction and classification. This paper evaluates the performance of our model on several benchmark datasets, including MNIST, Fashion-MNIST, CIFAR-10 and COVID-19 Radiography, demonstrating its ability to outperform some other Quantum Convolutional Neural Networks (QCNNs) in terms of many metrics. Experimental results indicate that the hybrid model achieves significant improvements in classification accuracy and computational efficiency, highlighting the potential of quantum-inspired techniques to enhance classical machine learning models.
This article proposes a quantum multimodal neural network (QMNN) model that can be implemented on parameterized quantum circuits (PQCs), providing a novel avenue for processing multimodal data and performing advanced multimodal sentiment analysis tasks. The comprehensive QMNN model is structured into four fundamental blocks: multimodal data preprocessing, unimodal feature extraction, multimodal feature fusion, and optimization. Through these blocks, multimodal data are initially preprocessed and encoded into quantum states. Subsequently, visual and textual features are extracted from the quantum states and are then integrated to learn the interactions between different modalities. Finally, the model parameters are fine-tuned to optimize the sentiment analysis performance. Simulation results confirm that QMNN surpasses state-of-the-art baselines, using significantly lower input dimensions and substantially fewer parameters than classical models. Furthermore, the entanglement, integrity, robustness, and scalability of the model are analyzed in depth. Internally, the strong entanglement within the multimodal fusion block enhances interactions between textual and visual features, and the integrity of the model reflects the indispensable contribution of each component to the overall performance. Externally, robustness ensures the model operates stably under noisy conditions and incomplete inputs, and scalability enables it to efficiently adapt to varying architectural depths and widths. The above simulation results and performance analyses showcase the comprehensive strength of our proposed model.
Convolutional Neural Networks (CNNs) are extensively utilized for image classification due to their ability to exploit data correlations effectively. However, traditional CNNs encounter several challenges, including limitations in accuracy improvement, computational efficiency, explain ability, and generalization. As data dimensionality or model complexity increases, CNNs often become more difficult to train efficiently, leading to slower processing times. To overcome these challenges, Quantum Convolutional Neural Networks (QCNNs) offer a promising quantum-based approach to enhance existing models, particularly by improving training efficiency and reducing processing times. This paper provides a comparative analysis of classical CNNs and a novel quantum circuit architecture tailored for image-based tasks. The analysis emphasizes the adaptability and potential of quantum circuits to enhance feature extraction, recognition accuracy, and processing efficiency.We applied various QCNN architectures to the Chinese-MNIST dataset and compared their performance with traditional CNN models. Although QCNNs achieved slightly lower accuracy, they demonstrated significantly greater stability. These findings high- light QCNNs’ potential to overcome the computational limitations of conventional deep learning, offering a promising pathway for quantum-enhanced solutions in computer vision. Future work will focus on refining quantum circuit designs, developing hybrid quantum-classical models, and extending QCNN applications to larger and more diverse datasets.
Classical convolutional neural networks (CNNs) have achieved notable success in image classification but face challenges in scalability, interpretability, and computational cost. With the growing availability of Noisy Intermediate-Scale Quantum (NISQ) devices, hybrid quantum-classical models offer a promising alternative by leveraging quantum parallelism and entanglement. In this work, we present a hybrid Quantum Convolutional Neural Network (QCNN) that integrates quantum convolutional layers into classical image classification pipeline for the MNIST dataset. Our architecture features a modular, low-depth Quantum Kernel Convolution (QKC) design suitable for near-term hardware. We implement the system using Qiskit and evaluate in terms of classification accuracy, circuit efficiency, and integration feasibility. Our results demonstrate that (i) the hybrid QCNN achieves similar accuracy to classical models while reducing the number of classical parameters, and (ii) quantum layers can successfully perform dimensionality reduction through entanglement-based pooling. This study highlights the potential of hybrid QCNN as a practical quantum-enhanced model for real-world image recognition tasks.
The objective of this research is to develop a Hybrid Quantum-Classical Convolutional Neural Network (QC-CNN) framework that integrates parameterized quantum circuits (PQCs) within classical CNN architectures to enhance image classification performance.The proposed model leverages quantum principles such as superposition and entanglement for high-dimensional feature representation, achieving superior accuracy and reduced computational complexity.Experiments on MNIST and CIFAR-10 datasets demonstrated improved classification accuracy of 98.7% and 82.5%, respectively, surpassing traditional CNNs while reducing training time by 33% and parameters by 45%.Statistical analysis confirmed the significance of these improvements.Visualizations using t-SNE revealed enhanced class separability, and noise perturbation tests validated the model's robustness.The results highlight the hybrid QC-CNN's potential for efficient and scalable quantum-enhanced deep learning applications.Extended evaluations, including quantum-layer-depth analysis, robustness testing, and t-SNE visualization, empirically support the hybrid QC-CNN's effectiveness across varied scenarios.