International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA)

Hybrid Classical-Quantum Optimization for Ensemble Learning

Lenny Putri Yulianti, Judhi Santoso, Agung Trisetyarso, Kridanto Surendro

Published Sep 28, 2022• 8 citations

Abstract

Ensemble learning has gained attention due to its ability to improve predictive performance in classification and regression problems. However, there are several issues related to optimizing accuracy, diversity, and efficiency simultaneously in the ensemble learning process. Existing studies mostly focus on one or two of them, or focus on all three but only on the specific process of ensemble learning. Besides, the quantum approach has been expected to accelerate the optimization process while maintaining accuracy. The contribution of this study is to design a hybrid classical-quantum methodology for optimizing ensemble learning in a holistic way. This methodology combines classical (i.e. clustering, improved evaluation measures, and generalized weighted ensemble with internally tuned hyperparameters) and quantum (i.e. quantum annealing) approaches, and this methodology is analyzed to provide more optimal results.

DOI: 10.1109/icaicta56449.2022.9932950

Related papers

A hybrid quantum annealing method for generating ensemble classifiers

Lenny Putri Yulianti, Agung Trisetyarso, Judhi Santoso +1 more

Quantum annealing has been widely used to optimize machine learning such as ensemble classifiers. This ensemble classifier enhances classification performance through the combination of multiple accurate and diverse base classifiers. It benefits from the “perturb and combine” strategy which involves using the random subspace as the prevalent approach to perturb input data. There are several methods to generate a random subspace which include bagging, boosting, clustering, and, more recently, clustering balancing. The main contribution of this research was to improve the accuracy of the ensemble classifier using the hybrid quantum annealing method. The process involved making larger, stronger, and more balanced clusters through 1) the modification of the range of values from K in incremental clustering, 2) the adjustment of the clusters to be stronger and more balanced, and 3) the optimization of pure-class clusters using quantum annealing. The proposed method was tested and evaluated on 10 benchmark datasets from the UCI repository and the results were compared with current approaches. The results showed that the proposed method has better accuracy than the others due to the larger, stronger, and more balanced clusters generated as well as the better trade-off between accuracy and diversity.

Journal of King Saud University - Computer and Information SciencesNov 3, 20236 citations

An efficient combination strategy for hybrid quantum ensemble classifier

Xiao-Ying Zhang, Ming‐Ming Wang

Quantum machine learning has shown advantages in many ways compared to classical machine learning. In machine learning, a difficult problem is how to learn a model with high robustness and strong generalization ability from a limited feature space. Combining multiple models as base learners, ensemble learning (EL) can effectively improve the accuracy, generalization ability and robustness of the final model. The key to EL lies in two aspects, the performance of base learners and the choice of the combination strategy. Recently, quantum EL (QEL) has been studied. However, existing combination strategies in QEL are inadequate in considering the accuracy and variance among base learners. This paper presents a hybrid EL framework that combines quantum and classical advantages. More importantly, we propose an efficient combination strategy for improving the accuracy of classification in the framework. We verify the feasibility and efficiency of our framework and strategy by using the MNIST dataset. Simulation results show that the hybrid EL framework with our combination strategy not only has a higher accuracy and lower variance than the single model without the ensemble, but also has a better accuracy than the majority voting and the weighted voting strategies in most cases.

International Journal of Quantum InformationMay 20, 20236 citations

Quantum-Enhanced Optimization: A Hybrid Quantum–Classical Framework for Machine Learning

Ayush Kumar Gupta

Quantum computing has emerged as one of the most influential paradigms capable of transforming computational processes that struggle under classical limitations. In recent years, hybrid quantum–classical algorithms have gained significant attention for their ability to leverage the strengths of both architectures, especially within the Noisy Intermediate-Scale Quantum (NISQ) era. This research paper explores a quantum-enhanced optimization framework designed to improve machine learning model performance through parameterized quantum circuits (PQCs). The goal of this study is to provide a practical, scalable approach that can be integrated into existing machine learning workflows without requiring fully developed fault-tolerant quantum hardware. The proposed framework uses classical preprocessing to encode data into quantum states, followed by quantum transformations that explore richer feature spaces due to quantum superposition and entanglement. A classical optimizer then updates the quantum circuit parameters based on measurement results, forming an end-to-end feedback loop. This hybrid model aims to demonstrate improved optimization efficiency, reduction in loss-function plateaus, and better generalization for specific ML tasks involving small to medium-sized datasets. This paper provides a comprehensive investigation of methodology, literature background, and experimental reasoning with statistical analysis, along with conceptual diagrams illustrating system architecture and circuit layouts. The outcomes further strengthen the viability of hybrid quantum–classical computation as a promising direction for advanced machine learning systems.

International Journal Of Scientific Research In Engineering & TechnologyNov 22, 20250 citations

Hybrid Quantum-Classical Neural Networks and its Hyperparameter Optimization-A Study

R Adithya, Joyline Dsa, Adarsh Rag S +1 more

In recent years, the field of machine learning has witnessed a paradigm shift with the emergence of hybrid quantum-classical neural networks. These networks combine the power of classical neural networks with the computational advantages offered by quantum variational circuits. This study presents a comprehensive survey of hybrid quantum-classical machine learning algorithms, focusing on their architecture, performance, and hyperparameter optimization techniques. Introducing the concept of hybrid quantum-classical machine learning and its significance in contemporary image classification tasks. It explores the theoretical foundations of quantum variational circuits and their integration with classical neural network architectures. Special attention is given to prominent algorithms such as Quantum Convolutional Neural Networks, Quanvolutional Neural Networks, and Quantum ResNet, each offering unique advantages in image classification tasks. A major aspect covered in this study is the hyperparameter optimization techniques employed in hybrid quantum-classical machine learning. The chapter discusses quantum-inspired optimization methods tailored for efficiently tuning the hyperparameters of complex neural network models. Through comparative analysis, the effectiveness of these optimization techniques is demonstrated in reducing computational overhead and improving model performance. Moreover, the study also delves into experimental results obtained from benchmarking hybrid quantum-classical models against traditional classical approaches. It highlights the accuracy variations observed across different quantum architectures and explores the impact of architectural permutations on model convergence. Insights gained from these experiments provide valuable guidance for researchers and practitioners seeking to leverage hybrid quantum-classical neural networks in real-world applications.

International Conference on Computing, Semiconductor, Mechatronics, Intelligent Systems and Communications (COSMIC)Nov 22, 20241 citation

An efficient combination strategy for hybird quantum ensemble classifier

Xiaoying Zhang, Mingming Wang

Quantum machine learning has shown advantages in many ways compared to classical machine learning. In machine learning, a difficult problem is how to learn a model with high robustness and strong generalization ability from a limited feature space. Combining multiple models as base learners, ensemble learning (EL) can effectively improve the accuracy, generalization ability, and robustness of the final model. The key to EL lies in two aspects, the performance of base learners and the choice of the combination strategy. Recently, quantum EL (QEL) has been studied. However, existing combination strategies in QEL are inadequate in considering the accuracy and variance among base learners. This paper presents a hybrid EL framework that combines quantum and classical advantages. More importantly, we propose an efficient combination strategy for improving the accuracy of classification in the framework. We verify the feasibility and efficiency of our framework and strategy by using the MNIST dataset. Simulation results show that the hybrid EL framework with our combination strategy not only has a higher accuracy and lower variance than the single model without the ensemble, but also has a better accuracy than the majority voting and the weighted voting strategies in most cases.

arXiv:2210.06785Oct 13, 20221 citation

A Hybrid Quantum Classical Framework for Enhanced Machine Learning Performance on High Dimensional Data

Nnaemeka Kingsley Ugwumba

Abstract This research presents a comprehensive hybrid quantum classical machine learning framework designed to overcome the computational limitations of classical algorithms when processing high dimensional data. The study integrates parameterized quantum circuits within classical neural network architectures and demonstrates their application across optimization tasks and supervised learning problems. The framework was evaluated on combinatorial optimization benchmarks including Max Cut and Job Shop Scheduling problems alongside classification tasks using quantum annealing based feature selection. Results demonstrate that hybrid quantum classical models achieve faster convergence rates and improved accuracy in high dimensional spaces compared to classical counterparts with the quantum algorithm for Max Cut optimization outperforming complete solution searches on larger problem instances. The findings provide machine learning practitioners and quantum computing researchers with validated hybrid architectures for near term quantum device deployment.

Mar 13, 20260 citations