Procedia Computer Science
Exploring Bagging Ensemble of Variational Quantum Classifiers with Out of Bag Weighting for Breast Cancer Diagnosis
Abhikarsha Sil, Barkha Soni, Nilay Khare
Abstract
In recent years, quantum machine learning (QML) has emerged as a promising approach for medical decision-making, with representative methods such as Quantum Support Vector Machines (QSVMs), Quantum Neural Networks (QNNs), and Variational Quantum Circuits (VQCs). Among these, VQCs are distinguished by their expressive capability; however, their training on small biomedical datasets often results in instability and high variance. To address this issue, we propose a heterogeneous ensemble of six shallow VQCs evaluated on the Wisconsin Breast Cancer Diagnostic (WBCD) dataset, which contains 569 diagnostic samples characterized by 30 cytological features and binary class labels differentiating benign and malignant cases. The ensemble introduces diversity through distinct feature maps, circuit architectures, and optimization strategies, using rotation gates (RX, RY, RZ) combined with entangling layers (CNOT, CZ). Model reliability is estimated from out-of-bag errors, with normalized weights calculated as the inverse of the mean squared error, and final decisions obtained via weighted soft voting. The preprocessing pipeline involves median imputation and standardization, followed by principal component analysis (PCA) to compress the 30-dimensional space into three to four principal components for quantum encoding. In our experiments, individual VQCs trained on the full dataset exhibited unstable accuracies ranging from 80% to 96% across three–four qubits, whereas the proposed ensemble achieved consistent performance of 95.71% (3 qubits) and 96.43% (4 qubits), reducing variance and matching strong classical baselines such as SVM and Random Forest. All models were implemented in PennyLane, utilizing the Lightning.qubit simulator for shot-free optimization and the default.mixed device for noise-aware evaluation, demonstrating the potential of weighted quantum ensembles for reliable biomedical classification.