Recent advancements in quantum computing have shown promising computational advantages in many problem areas. As one of those areas with increasing attention, hybrid quantum-classical machine learning systems have demonstrated the capability to solve various data-driven learning tasks. Recent works show that parameterized quantum circuits (PQCs) can be used to solve challenging reinforcement learning (RL) tasks with provable learning advantages. While existing works yield potentials of PQC-based methods, the design choices of PQC architectures and their influences on the learning tasks are generally underexplored. In this work, we introduce EQAS-PQC, an evolutionary quantum architecture search framework for PQC-based models, which uses a population-based genetic algorithm to evolve PQC architectures by exploring the search space of quantum operations. Experimental results show that our method can significantly improve the performance of hybrid quantum-classical models in solving benchmark reinforcement problems. We also model the probability distributions of quantum operations in top-performing architectures to identify essential design choices that are critical to the performance.
Recent advancements in quantum computing have shown promising computational advantages in many problem areas. As one of those areas with increasing attention, hybrid quantum-classical machine learning systems have demonstrated the capability to solve various data-driven learning tasks. Recent works show that parameterized quantum circuits (PQCs) can be used to solve challenging reinforcement learning (RL) tasks with provable learning advantages. While existing works yield potentials of PQC-based methods, the design choices of PQC architectures and their influences on the learning tasks are generally underexplored. In this work, we introduce EQAS-PQC, an evolutionary quantum architecture search framework for PQC-based models, which uses a population-based genetic algorithm to evolve PQC architectures by exploring the search space of quantum operations. Experimental results show that our method can significantly improve the performance of hybrid quantum-classical models in solving benchmark reinforcement problems. We also model the probability distributions of quantum operations in top-performing architectures to identify essential design choices that are critical to the performance.
Recent work on hybrid quantum-classical machine learning systems has demonstrated success in utilizing parameterized quantum circuits (PQCs) to solve the challenging reinforcement learning (RL) tasks, with provable learning advantages over classical systems, e.g., deep neural networks. While existing work demonstrates and exploits the strength of PQC-based models, the design choices of PQC architectures and the interactions between different quantum circuits on learning tasks are generally underexplored. In this work, we introduce a Multi-objective Evolutionary Architecture Search framework for parameterized quantum circuits (MEAS-PQC), which uses a multi-objective genetic algorithm with quantum-specific configurations to perform efficient searching of optimal PQC architectures. Experimental results show that our method can find architectures that have superior learning performance on three benchmark RL tasks, and are also optimized for additional objectives including reductions in quantum noise and model size. Further analysis of patterns and probability distributions of quantum operations helps identify performance-critical design choices of hybrid quantum-classical learning systems.
Quantum computing leverages quantum mechanics to address computational problems in ways that differ fundamentally from classical approaches. While current quantum hardware remains error-prone and limited in scale, Variational Quantum Circuits offer a noise-resilient framework suitable for today's devices. The performance of these circuits strongly depends on the underlying architecture of their parameterized quantum components. Identifying efficient, hardware-compatible quantum circuit architectures -- known as Quantum Architecture Search (QAS) -- is therefore essential. Manual QAS is complex and error-prone, motivating efforts to automate it. Among various automated strategies, Reinforcement Learning (RL) remains underexplored, particularly in Quantum Machine Learning contexts. This work introduces RL-QAS, a framework that applies RL to discover effective circuit architectures for classification tasks. We evaluate RL-QAS using the Iris and binary MNIST datasets. The agent autonomously discovers low-complexity circuit designs that achieve high test accuracy. Our results show that RL is a viable approach for automated architecture search in quantum machine learning. However, applying RL-QAS to more complex tasks will require further refinement of the search strategy and performance evaluation mechanisms.
Quantum Architecture Search (QAS) is an emerging field aimed at automating the design of quantum circuits for optimal performance. This paper introduces a novel QAS framework employing hybrid quantum reinforcement learning with quantum curriculum learning strategies, enabling learning agents to tackle increasingly complex quantum circuit design tasks. We benchmark four state-of-the-art classical reinforcement learning algorithms (A2C, PPO, DDQN, TD3) against their quantum-enhanced counterparts (QA2C, QPPO, QDDQN, QTD3) for optimizing variational quantum circuits (VQCs). Our approach progressively increases circuit depth and gate complexity during training, leveraging parameterized quantum circuits as function approximations. To improve learning efficiency and stability, all algorithms, both classical and quantum, are augmented with Prioritized Experience Replay (PER). Experimental results show that quantum-enhanced RL significantly outperforms classical methods. In a 2-qubit environment, PERQDDQN achieves a success probability of 0.46 with 3,000 optimal successes, surpassing classical PERDDQN (0.42,2,400). In the more complex 3-qubit setting, PERQDDQN and PERQTD3 reach success probabilities of 0.47, with optimal success counts of 3,800 and 3,600, respectively, outperforming their classical counterparts. Additionally, we apply our QAS-QTN approach to a classification problem, where the optimized quantum circuit achieves an accuracy of 90.33%, outperforming quantum models consisting of random ansatz. This hybrid classical-quantum approach leads to faster convergence and more efficient quantum circuit designs, demonstrating its potential for advancing automated quantum architecture search.
Quantum Machine Learning (QML) utilizes the principles of quantum computations to improve the performance of learning by the use of parameterized quantum circuits and variational algorithms. But despite the qubit number, circuit depth, and patterns of entanglement, creating the optimal quantum circuit architectures for particular machine learning applications remains an important problem. Fixed circuits, or classical Neural Architecture Search (NAS), are not enough to transfer knowledge to other tasks and/or to search the quantum search space efficiently. In this context, this paper presents an Adaptive Quantum Circuit Architecture Search (AQ CAS) framework that dynamically generates and optimizes quantum circuit architectures using a hybrid search algorithm that integrates reinforcement learning, evolutionary operators, and evaluation without gradient. AQ CAS involves a task-specific feedback mechanism to eliminate those candidates that perform poorly and concentrate the search on those candidates with good performance. The framework is evaluated on benchmark data sets such as Iris, synthetic classical ML tasks, and hybrid quantum-classical tasks, and compared to fixed circuits, existing quantum NAS methods, and classical machine learning models. Experimental results indicate that AQ CAS can achieve higher accuracy for the task, using fewer qubits, fewer layers, and less training time, which further shows the need for adaptivity and task specialization. These results inform us about efficient hybrid classical-quantum pipelines, and give a glimpse of the directions that adaptive architecture search might take in enabling scalable and practical QML deployment.
Quantum computing combined with machine learning, is a promising emerging field for tackling problems that are extremely expensive or fundamentally infeasible for classical computers. Nonetheless, design of the optimal quantum circuit for machine learning is a major challenge, which can be attributed to the exponential search space of the quantum gate arrangement and unmatched structured design methods. To resolve this, our work introduces a novel automated framework for quantum architecture search (AQAS) that adopts both meta-learning and evolutionary algorithms to automatically learn, transfer, and optimize quantum circuit architectures to suit different machine learning tasks. Our strategy relies on meta-learning to introduce a learning scheme, i.e. it allows the AQAS system to generalize across distributions by learning from a shared structural and functional prior from the distribution of machine learning problems. This enables the approach to quickly home in effective quantum circuit implementations for new tasks with low data or retraining. At the same time, we use evolutionary algorithms– mimicking natural selection– to breed populations of quantum circuit architectures. These circuits are represented in genotypes, are varied under mutation and crossover, and are selected according to a fitness function that blends quantum resource utilization (e.g., depth, qubits) with task-specific performance (e.g., classification accuracy or loss). The architecture is realized in a mixed quantum-classical environment, with quantum circuits simulated on quantum simulators and/or Noisy-Intermediate-Scale-Quantum (NISQ) devices. We verify the effectiveness of our approach on a number of benchmarked datasets and tasks which range from quantum-aided image recognition, time series prediction to medical diagnostics. We demonstrate that AQAS can discover compact, high-performing quantum models, which generalize better and are computationally more efficient than the custom-built quantum models.
Quantum computing has made significant progress in recent years, attracting immense interest not only in research laboratories but also in various industries. However, the application of quantum computing to solve real-world problems is still hampered by a number of challenges, including hardware limitations and a relatively under-explored landscape of quantum algorithms, especially when compared to the extensive development of classical computing. The design of quantum circuits, in particular parameterized quantum circuits (PQCs), which contain learnable parameters optimized by classical methods, is a non-trivial and time-consuming task requiring expert knowledge. As a result, research on the automated generation of PQCs, known as quantum architecture search (QAS), has gained considerable interest. QAS focuses on the use of machine learning and optimization-driven techniques to generate PQCs tailored to specific problems and characteristics of quantum hardware. In this paper, we provide an overview of QAS methods by examining relevant research studies in the field. We discuss the main challenges in designing and performing an automated search for an optimal PQC, and survey ways to address them to ease future research.