Feature selection remains a challenge in high-dimensional data analysis. Identifying the optimal feature subset is a complex combinatorial problem often classified as nondeterministic polynomial-time-hard. Traditional classical heuristics frequently struggle to navigate the exponentially growing search space. In this paper, we propose a feature selection method utilizing the quantum approximate optimization algorithm (QAOA) integrated with a layerwise grid search (LGS) strategy. By formulating feature selection as a max-cut problem, we leverage QAOA to optimize the selection process. Unlike standard global optimization, the LGS approach sequentially optimizes parameters for each circuit layer. This systematic discretization of the parameter space ensures stable convergence and enhances overall performance. Experimental evaluations on the iris flower dataset demonstrate the effectiveness of the proposed method in addressing feature selection challenges.
Feature selection remains a challenge in high-dimensional data analysis. Identifying the optimal feature subset is a complex combinatorial problem often classified as nondeterministic polynomial-time-hard. Traditional classical heuristics frequently struggle to navigate the exponentially growing search space. In this paper, we propose a feature selection method utilizing the quantum approximate optimization algorithm (QAOA) integrated with a layerwise grid search (LGS) strategy. By formulating feature selection as a max-cut problem, we leverage QAOA to optimize the selection process. Unlike standard global optimization, the LGS approach sequentially optimizes parameters for each circuit layer. This systematic discretization of the parameter space ensures stable convergence and enhances overall performance. Experimental evaluations on the iris flower dataset demonstrate the effectiveness of the proposed method in addressing feature selection challenges.
The quantum approximate optimization algorithm (QAOA) is an efficient method for solving combinatorial optimization problems in quantum computing. These problems involve finding the best solution from a finite set of possibilities. At its core, the QAOA uses an Ansatz circuit composed of alternating unitary operators, the mixing and problem Hamiltonians, that are controlled by a set of parameters. Its goal is to find the optimal parameters so that the final quantum state of the circuit encodes the problem’s solution. While this parameter optimization is often handled by classical optimizers, including constrained optimization by linear approximations (COBYLA) and Nelder–Mead, these methods frequently present local extrema. Therefore, we developed a layerwise grid search (LGS) method as an alternative. Since a full grid search is too time-consuming, the LGS method significantly reduces the search time while still finding a good solution. To demonstrate its effectiveness, we present experimental results for the max-cut problem, comparing the performance of our LGS method against conventional classical optimizers.
Feature selection plays a significant role in computer science; nevertheless, this task is intractable since its search space scales exponentially with the number of dimensions. Motivated by the potential advantages of near-term quantum computing, three graph-theoretic feature selection (GTFS) methods, including minimum cut (MinCut)-based, densestk-subgraph (DkS)-based, and maximal-independent set/minimal vertex cover (MIS/MVC)-based, are investigated in this article, where the original graph-theoretic problems are naturally formulated as the quadratic problems in binary variables and then solved using the quantum approximate optimization algorithm (QAOA). Specifically, three separate graphs are created from the raw feature set, where the vertex set consists of individual features and pairwise measure describes the edge. The corresponding feature subset is generated by deriving a subgraph from the established graph using QAOA. For the above three GTFS approaches, the solving procedure and quantum circuit for the corresponding graph-theoretic problems are formulated with the framework of QAOA. In addition, those proposals could be employed as a local solver and integrated with the Tabu search algorithm for solving large-scale GTFS problems utilizing limited quantum bit resource. Finally, extensive numerical experiments are conducted with 20 publicly available datasets and the results demonstrate that each model is superior to its classical scheme. In addition, the complexity of each model is onlyO(pn2)even in the worst cases, wherepis the number of layers in QAOA andnis the number of features.
As the volume of data for classification tasks in machine learning grows, feature selection plays an increasingly crucial role in enhancing the efficiency and effectiveness of these tasks. Existing classical feature selection algorithms often encounter challenges, such as high computational complexity and vulnerability to local optima. Quantum algorithms have been proposed to overcome these limitations. Here, our work proposes a new approach that combines the Quantum Approximate Optimization Algorithm (QAOA) with the classical feature selection algorithm Maximum Relevance-Minimum Redundancy (MRMR). First, we transform the feature selection problem into the Quadratic Unconstrained Binary Optimization (QUBO) problem. Then, we map the QUBO formulation to Hamiltonian with the Ising model. Finally, we employ QAOA with a shallow circuit to search this Hamiltonian's ground state, which matches the specific solution for feature selection. We conducted numerical experiments on eight real-world datasets for classification tasks from diverse domains, including finance, medicine, and natural hazards. Experiment results suggest that QAOA-selected feature subsets size are typically less than half the complete set while achieving comparable or better classification accuracy than classical MRMR, demonstrating its preference for smaller, more efficient feature subsets.
This paper introduces a novel variational quantum algorithm built upon the established Quantum Approximate Optimization Algorithm also known as QAOA. Since the known parameter fixing strategy imposes constraints on QAOA to enhance tractability at the cost of some expressive power, the proposed layerwise approach integrates it with the existing Multi-Angle QAOA technique, which is characterized in turn by height-ened expressiveness through an increased number of parameters, albeit with increased optimization challenges. Consequently, the proposed layerwise-Multi-Angle QAOA combines the strengths of one variant with the limitations of the other, striking a balance in algorithmic design. The effectiveness of the proposed algorithm is assessed through experimental evaluations on the Maximum Cut problem. This study reveals promising results in heuristic predictions, with robustness both in terms of approximation ratio and optimization capabilities.
In the Noisy Intermediate-Scale Quantum (NISQ) era, the Quantum Approximate Optimization Algorithm (QAOA) has attracted significant attention as an algorithm for solving combinatorial optimization problems that are classically intractable. Various modifications and training strategies have been proposed to enhance the performance of QAOA. However, as the circuit depth increases, existing methods encounter greater training difficulty and reach a barren plateau in performance improvements. In this paper, we propose the Smart Insert Layerwise QAOA (SIL QAOA) to overcome these challenges. In SIL QAOA, at each stage, a new layer is inserted into all possible positions; each circuit is independently optimized, and the parameter set from the circuit yielding the highest expectation value is adopted as the initial parameter for the next stage. Applying the proposed method to the MaxCut problem, we achieved up to approximately 11% higher approximation ratios compared to conventional Layerwise learning QAOA, while successfully mitigating early performance saturation observed at shallow depths. These results demonstrate the superior performance improvement capability of SIL QAOA. Furthermore, we also discuss its potential applicability to more complex optimization problems and deeper variational quantum circuits in future work.
The quantum approximate optimization algorithm (QAOA) is a variational quantum algorithm (VQA) ideal for noisy intermediate-scale quantum (NISQ) processors, and is highly successful in solving combinatorial optimization problems (COPs). It has been observed that the optimal parameters obtained from one instance of a COP can be transferred to another instance, resulting in generally good solutions for the latter. In this work, we propose a refinement scheme in which only a subset of QAOA layers is optimized following parameter transfer, with a focus on the Max-Cut problem. Our motivation is to reduce the complexity of the loss landscape when optimizing all the layers of high-depth QAOA circuits, as well as to reduce the optimization time. We investigate the potential hierarchical roles of different layers and analyze how the approximation ratio scales with increasing problem size. Our findings indicate that the selective layer optimization scheme offers a favorable trade-off between solution quality and computational time, and can be more beneficial than full optimization at a lower optimization time.