Abstract Variational quantum algorithms (VQAs) are expected to be a path to quantum advantages on noisy intermediate-scale quantum devices. However, both empirical and theoretical results exhibit that the deployed ansatz heavily affects the performance of VQAs such that an ansatz with a larger number of quantum gates enables a stronger expressivity, while the accumulated noise may render a poor trainability. To maximally improve the robustness and trainability of VQAs, here we devise a resource and runtime efficient scheme termed quantum architecture search (QAS). In particular, given a learning task, QAS automatically seeks a near-optimal ansatz (i.e., circuit architecture) to balance benefits and side-effects brought by adding more noisy quantum gates to achieve a good performance. We implement QAS on both the numerical simulator and real quantum hardware, via the IBM cloud, to accomplish data classification and quantum chemistry tasks. In the problems studied, numerical and experimental results show that QAS cannot only alleviate the influence of quantum noise and barren plateaus but also outperforms VQAs with pre-selected ansatze.
Abstract Variational quantum algorithms (VQAs) are expected to be a path to quantum advantages on noisy intermediate-scale quantum devices. However, both empirical and theoretical results exhibit that the deployed ansatz heavily affects the performance of VQAs such that an ansatz with a larger number of quantum gates enables a stronger expressivity, while the accumulated noise may render a poor trainability. To maximally improve the robustness and trainability of VQAs, here we devise a resource and runtime efficient scheme termed quantum architecture search (QAS). In particular, given a learning task, QAS automatically seeks a near-optimal ansatz (i.e., circuit architecture) to balance benefits and side-effects brought by adding more noisy quantum gates to achieve a good performance. We implement QAS on both the numerical simulator and real quantum hardware, via the IBM cloud, to accomplish data classification and quantum chemistry tasks. In the problems studied, numerical and experimental results show that QAS cannot only alleviate the influence of quantum noise and barren plateaus but also outperforms VQAs with pre-selected ansatze.
Quantum error mitigation techniques are at the heart of quantum hardware implementation, and are the key to performance improvement of the variational quantum learning scheme (VQLS). Although VQLS is partially robust to noise, both empirical and theoretical results exhibit that noise would rapidly deteriorate the performance of most variational quantum algorithms in large-scale problems. Furthermore, VQLS suffers from the barren plateau phenomenon---the gradient generated by the classical optimizer vanishes exponentially with respect to the qubit number. Here we devise a resource and runtime efficient scheme, the quantum architecture search scheme (QAS), to maximally improve the robustness and trainability of VQLS. In particular, given a learning task, QAS actively seeks an optimal circuit architecture to balance benefits and side-effects brought by adding more quantum gates. Specifically, while more quantum gates enable a stronger expressive power of the quantum model, they introduce a larger amount of noise and a more serious barren plateau scenario. Consequently, QAS can effectively suppress the influence of quantum noise and barren plateaus. We implement QAS on both the numerical simulator and real quantum hardware, via the IBM cloud, to accomplish data classification and quantum chemistry tasks. Numerical and experimental results show that QAS significantly outperforms conventional variational quantum algorithms with heuristic circuit architectures. Our work provides practical guidance for developing advanced learning-based quantum error mitigation techniques on near-term quantum devices.
Variational quantum algorithms (VQAs) have shown strong evidence to gain provable computational advantages in diverse fields such as finance, machine learning, and chemistry. However, the heuristic ansatz exploited in modern VQAs is incapable of balancing the trade-off between expressivity and trainability, which may lead to degraded performance when executed on noisy intermediate-scale quantum (NISQ) machines. To address this issue, here, we demonstrate the first proof-of-principle experiment of applying an efficient automatic ansatz design technique, i.e., quantum architecture search (QAS), to enhance VQAs on an 8-qubit superconducting quantum processor. In particular, we apply QAS to tailor the hardware-efficient ansatz toward classification tasks. Compared with heuristic ansätze, the ansatz designed by QAS improves the test accuracy from 31% to 98%. We further explain this superior performance by visualizing the loss landscape and analyzing effective parameters of all ansätze. Our work provides concrete guidance for developing variable ansätze to tackle various large-scale quantum learning problems with advantages.
A significant hurdle in the noisy intermediate-scale quantum (NISQ) era is identifying functional quantum circuits. These circuits must also adhere to the constraints imposed by current quantum hardware limitations. Variational quantum algorithms (VQAs), a class of quantum-classical optimization algorithms, were developed to address these challenges in the currently available quantum devices. However, the overall performance of VQAs depends on the initialization strategy of the variational circuit, the structure of the circuit (also known as ansatz), and the configuration of the cost function. Focusing on the structure of the circuit, in this thesis, we improve the performance of VQAs by automating the search for an optimal structure for the variational circuits using reinforcement learning (RL). Within the thesis, the optimality of a circuit is determined by evaluating its depth, the overall count of gates and parameters, and its accuracy in solving the given problem. The task of automating the search for optimal quantum circuits is known as quantum architecture search (QAS). The majority of research in QAS is primarily focused on a noiseless scenario. Yet, the impact of noise on the QAS remains inadequately explored. In this thesis, we tackle the issue by introducing a tensor-based quantum circuit encoding, restrictions on environment dynamics to explore the search space of possible circuits efficiently, an episode halting scheme to steer the agent to find shorter circuits, a double deep Q-network (DDQN) with an ε-greedy policy for better stability. The numerical experiments on noiseless and noisy quantum hardware show that in dealing with various VQAs, our RL-based QAS outperforms existing QAS. Meanwhile, the methods we propose in the thesis can be readily adapted to address a wide range of other VQAs.
The key challenge in the noisy intermediate-scale quantum era is finding useful circuits compatible with current device limitations. Variational quantum algorithms (VQAs) offer a potential solution by fixing the circuit architecture and optimizing individual gate parameters in an external loop. However, parameter optimization can become intractable, and the overall performance of the algorithm depends heavily on the initially chosen circuit architecture. Several quantum architecture search (QAS) algorithms have been developed to design useful circuit architectures automatically. In the case of parameter optimization alone, noise effects have been observed to dramatically influence the performance of the optimizer and final outcomes, which is a key line of study. However, the effects of noise on the architecture search, which could be just as critical, are poorly understood. This work addresses this gap by introducing a curriculum-based reinforcement learning QAS (CRLQAS) algorithm designed to tackle challenges in realistic VQA deployment. The algorithm incorporates (i) a 3D architecture encoding and restrictions on environment dynamics to explore the search space of possible circuits efficiently, (ii) an episode halting scheme to steer the agent to find shorter circuits, and (iii) a novel variant of simultaneous perturbation stochastic approximation as an optimizer for faster convergence. To facilitate studies, we developed an optimized simulator for our algorithm, significantly improving computational efficiency in simulating noisy quantum circuits by employing the Pauli-transfer matrix formalism in the Pauli-Liouville basis. Numerical experiments focusing on quantum chemistry tasks demonstrate that CRLQAS outperforms existing QAS algorithms across several metrics in both noiseless and noisy environments.
The advent of Noisy Intermediate-Scale Quantum (NISQ) devices provides crucial promise for the development of quantum algorithms. Variational quantum algorithms have emerged as one of the best hopes to utilize NISQ devices. Among these is the famous Variational Quantum Eigensolver (VQE), where one trains a parameterized and fixed quantum circuit (or an ansatz) to accomplish the task. However, VQE also suffers from some serious challenges, which are training difficulty and accuracy reduction due to deep quantum circuit and hardware noise. To be motivated by these issues, we propose a runtime and resource efficient scheme, monto-carlo tree (MCT) search based quantum circuit architecture optimization, where the ansatz is built in the variable form. Our approach first models the search space with a MCT and regards it as a supernet, where we make use of layers dependence to reduce the size of the search space . Second, a two-stage scheme is proposed for the search space training where weight sharing and warm-up strategies are employed to avoid huge computation cost. Training results are stored in nodes of the MCT for future decisions and a hierarchical node selection is presented to obtain an optimal ansatz. As a proof of principle, we carry out a series of numerical experiments for condensed matter and quantum chemistry in the quantum simulator with and without noise. Consequently, our scheme can be efficient to mitigate trainability and accuracy issues by minimizing the ansatz depth and the number of entanglement gates.
Quantum variational algorithms (VQAs) are highly promising to realize quantum advantages on near-term quantum devices. Existing VQAs based on a manually fixed quantum are computationally inefficient due to noise and the limited coupling maps of these devices. Previous work considers various quantum architecture search (QAS) algorithms to autodesign a quantum based on specific questions to improve the performance of VQAs. Compared to manual design, autodesign can more efficiently explore the large space of a possible and achieve better performance. However, two main challenges in utilizing QAS to design quantum circuits efficiently are the tremendous amount of space required for candidate quantum circuits, and the disconnection between quantum devices and autodesign in terms of qubit mapping and quantum noise. To address these issues, we propose an adaptive diversity-based quantum search algorithm to efficiently generate the optimal quantum circuit based on device qubit mapping and noise. By considering the diversity among different candidate circuits and adaptively adding circuit depths, our approach only needs to focus on a small optimization space at each iteration step. In addition, the synchronization of optimizing circuit structure and aligning qubit mapping enables us to generate quantum circuits while avoiding additional mapping overhead. We evaluate the performance of our algorithm on simulators and real quantum devices for quantum eigenvalue problems and classification tasks. Results demonstrate that quantum circuits generated by our method outperform both a fixed hardware-efficient and randomly generated quantum circuits in terms of final performance and resource-saving. Our algorithm provides a flexible way to efficiently generate excellent quantum circuits for significantly improving the performances of VQAs on near-term quantum devices. Published by the American Physical Society 2024