Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Quantum Circuit Search using Deep Reinforcement Learning

Daimon Shunsuke

Published Jul 24, 2024• 0 citations
OpenAlex

Abstract

Quantum coherence in a qubit is vulnerable to environmental noise. When long quantum calculation is run on a quantum processor without error correction, the noise causes fatal errors and messes up the calculation. In order to maximize the functionality of quantum computers, it is essential to design quantum circuits that suppress the effects of noise. In this research, we developed a deep reinforcement learning AI that searches for quantum circuits that are less affected by noise. Using the developed AI, we succeeded in generating quantum circuits that achieve quantum Fourier transform while suppressing the effects of noise.

Related papers

Quantum circuit distillation and compression

Shunsuke Daimon, Kakeru Tsunekawa, Ryoto Takeuchi +3 more

Abstract Quantum coherence in a qubit is vulnerable to environmental noise. When long quantum calculation is run on a quantum processor without error correction, the noise causes fatal errors and messes up the calculation. Here, we propose quantum-circuit distillation to generate quantum circuits that are short but have enough functions to produce an output similar to that of the original circuits. The distilled circuits are less sensitive to the noise and can complete calculation before the quantum coherence is broken. We created a quantum-circuit distillator by building a reinforcement learning model, and applied it to the inverse quantum Fourier transform (IQFT) and Shor’s quantum prime factorization. The obtained distilled circuit allows correct calculation on IBM-Quantum processors. By working with the distillator, we also found a general rule to generate quantum circuits approximating the general n -qubit IQFTs. The quantum-circuit distillator offers a new approach to improve performance of noisy quantum processors.

arXiv:2309.01911•Japanese Journal of Applied Physics•Feb 15, 2024•4 citations

Quantum Architecture Search via Continual Reinforcement Learning

Esther Ye, Samuel Yen-Chi Chen

Quantum computing has promised significant improvement in solving difficult computational tasks over classical computers. Designing quantum circuits for practical use, however, is not a trivial objective and requires expert-level knowledge. To aid this endeavor, this paper proposes a machine learning-based method to construct quantum circuit architectures. Previous works have demonstrated that classical deep reinforcement learning (DRL) algorithms can successfully construct quantum circuit architectures without encoded physics knowledge. However, these DRL-based works are not generalizable to settings with changing device noises, thus requiring considerable amounts of training resources to keep the RL models up-to-date. With this in mind, we incorporated continual learning to enhance the performance of our algorithm. In this paper, we present the Probabilistic Policy Reuse with deep Q-learning (PPR-DQL) framework to tackle this circuit design challenge. By conducting numerical simulations over various noise patterns, we demonstrate that the RL agent with PPR was able to find the quantum gate sequence to generate the two-qubit Bell state faster than the agent that was trained from scratch. The proposed framework is general and can be applied to other quantum gate synthesis or control problems -- including the automatic calibration of quantum devices.

arXiv:2112.05779•Dec 10, 2021•15 citations

ENHANCING QUANTUM ERROR CORRECTION: OPTIMIZING NOISE REDUCTION TECHNIQUES FOR RELIABLE QUANTUM COMPUTATION

Ms. Priya D. Milke, Ms.Riya V. Shende, Ms.Rewati G. Patil +5 more

Quantum computing holds the potential to revolutionize computation by solving complex problems that classical computers cannot. However, quantum systems are highly susceptible to errors due to noise and decoherence. In this paper, we propose a novel hybrid AI-Quantum approach for Quantum Error Correction (QEC) to optimize noise reduction techniques. By leveraging deep learning and reinforcement learning, we develop a method to predict and correct quantum noise in real time. Our experiments, conducted on IBM Qiskit simulators and actual quantum processors, demonstrate a significant reduction in quantum gate errors compared to traditional QEC codes. Our method achieves improved fault tolerance with reduced qubit overhead, paving the way for scalable and reliable quantum computation. Furthermore, we make our research publicly available with open-source Python code and an interactive Jupyter notebook, enabling others to replicate and extend our work.

International Journal of Advance Scientific Research and Engineering Trends•Aug 14, 2024•0 citations

Quantum Architecture Search via Deep Reinforcement Learning

En-Jui Kuo, Yao-Lung L. Fang, Samuel Yen-Chi Chen

Recent advances in quantum computing have drawn considerable attention to building realistic application for and using quantum computers. However, designing a suitable quantum circuit architecture requires expert knowledge. For example, it is non-trivial to design a quantum gate sequence for generating a particular quantum state with as fewer gates as possible. We propose a quantum architecture search framework with the power of deep reinforcement learning (DRL) to address this challenge. In the proposed framework, the DRL agent can only access the Pauli-$X$, $Y$, $Z$ expectation values and a predefined set of quantum operations for learning the target quantum state, and is optimized by the advantage actor-critic (A2C) and proximal policy optimization (PPO) algorithms. We demonstrate a successful generation of quantum gate sequences for multi-qubit GHZ states without encoding any knowledge of quantum physics in the agent. The design of our framework is rather general and can be employed with other DRL architectures or optimization methods to study gate synthesis and compilation for many quantum states.

arXiv:2104.07715•Apr 15, 2021•41 citations

A Brief Survey of Quantum Architecture Search

Weiwei Zhu, Jiangtao Pi, Qiuyuan Peng

With the rapid development of quantum computing, the variational quantum algorithms capitalize on the classical optimizer and parametrized quantum circuit to provide outperformance on specific tasks such as combinatorial optimization problems. However, the performance of these hybrid quantum-classical algorithms heavily relies on the design of quantum circuit architecture. Being restricted by the noise of the near-term quantum device, how to trade off the computational power of quantum circuits and the noise of quantum gates is a challenging task for design circuit architecture. In this paper, we give a brief view of the recently proposed methods for quantum architecture search including the differentiable circuit search method, deep reinforcement learning based method, and evolutionary based methods.

International Conference on Algorithms, Computing and Systems (ICACS)•Sep 16, 2022•8 citations

Implementation of Quantum Deep Reinforcement Learning Using Variational Quantum Circuits

S Lokes, C. Sakthi Jay Mahenthar, S Parvatha Kumaran +2 more

With the evolution of technology, the need to solve complex computational problems like machine learning and deep learning has shot up. However, even the most powerful classical supercomputers find it difficult to execute these tasks. Advancements in quantum computing are leading researchers and tech-giants who strive for better quantum circuits to do machine learning tasks. Current works on Quantum Machine Learning (QML) ensure less memory consumption and reduced model parameters. However, it is strenuous to simulate the classical deep learning approach on existing quantum computing devices due to the inflexibility of Deep quantum circuits. Consequently, designing viable quantum algorithms for QML for noisy intermediate-scale quantum (NISQ) devices is essential. The proposed work aims to explore Variational Quantum Circuits (VQC) for Deep Q network-based Reinforcement Learning by remodeling the target network and experience replay into a representation of VQC. In addition, to the reduction in model parameters, quantum information encoding schemes are used to achieve better results than classical neural networks. VQCs are employed for policyselection and decision-making reinforcement learning by approximating the deep Q-value function with target network and experience replay.

International Conference on Trends in Quantum Computing and Emerging Business Technologies (TQCEBT)•Oct 13, 2022•19 citations
Quantum coherence in a qubit is vulnerable to environmental noise. When long quantum calculation is run on a quantum processor without error correction, the noise causes fatal errors and messes up the calculation. In order to maximize the functionality of quantum computers, it is essential to design quantum circuits that suppress the effects of noise. In this research, we developed a deep reinforcement learning AI that searches for quantum circuits that are less affected by noise. Using the developed AI, we succeeded in generating quantum circuits that achieve quantum Fourier transform while suppressing the effects of noise.
Abstract Quantum coherence in a qubit is vulnerable to environmental noise. When long quantum calculation is run on a quantum processor without error correction, the noise causes fatal errors and messes up the calculation. Here, we propose quantum-circuit distillation to generate quantum circuits that are short but have enough functions to produce an output similar to that of the original circuits. The distilled circuits are less sensitive to the noise and can complete calculation before the quantum coherence is broken. We created a quantum-circuit distillator by building a reinforcement learning model, and applied it to the inverse quantum Fourier transform (IQFT) and Shor’s quantum prime factorization. The obtained distilled circuit allows correct calculation on IBM-Quantum processors. By working with the distillator, we also found a general rule to generate quantum circuits approximating the general n -qubit IQFTs. The quantum-circuit distillator offers a new approach to improve performance of noisy quantum processors.
Quantum computing has promised significant improvement in solving difficult computational tasks over classical computers. Designing quantum circuits for practical use, however, is not a trivial objective and requires expert-level knowledge. To aid this endeavor, this paper proposes a machine learning-based method to construct quantum circuit architectures. Previous works have demonstrated that classical deep reinforcement learning (DRL) algorithms can successfully construct quantum circuit architectures without encoded physics knowledge. However, these DRL-based works are not generalizable to settings with changing device noises, thus requiring considerable amounts of training resources to keep the RL models up-to-date. With this in mind, we incorporated continual learning to enhance the performance of our algorithm. In this paper, we present the Probabilistic Policy Reuse with deep Q-learning (PPR-DQL) framework to tackle this circuit design challenge. By conducting numerical simulations over various noise patterns, we demonstrate that the RL agent with PPR was able to find the quantum gate sequence to generate the two-qubit Bell state faster than the agent that was trained from scratch. The proposed framework is general and can be applied to other quantum gate synthesis or control problems -- including the automatic calibration of quantum devices.
Quantum computing holds the potential to revolutionize computation by solving complex problems that classical computers cannot. However, quantum systems are highly susceptible to errors due to noise and decoherence. In this paper, we propose a novel hybrid AI-Quantum approach for Quantum Error Correction (QEC) to optimize noise reduction techniques. By leveraging deep learning and reinforcement learning, we develop a method to predict and correct quantum noise in real time. Our experiments, conducted on IBM Qiskit simulators and actual quantum processors, demonstrate a significant reduction in quantum gate errors compared to traditional QEC codes. Our method achieves improved fault tolerance with reduced qubit overhead, paving the way for scalable and reliable quantum computation. Furthermore, we make our research publicly available with open-source Python code and an interactive Jupyter notebook, enabling others to replicate and extend our work.
Recent advances in quantum computing have drawn considerable attention to building realistic application for and using quantum computers. However, designing a suitable quantum circuit architecture requires expert knowledge. For example, it is non-trivial to design a quantum gate sequence for generating a particular quantum state with as fewer gates as possible. We propose a quantum architecture search framework with the power of deep reinforcement learning (DRL) to address this challenge. In the proposed framework, the DRL agent can only access the Pauli-XXX, YYY, ZZZ expectation values and a predefined set of quantum operations for learning the target quantum state, and is optimized by the advantage actor-critic (A2C) and proximal policy optimization (PPO) algorithms. We demonstrate a successful generation of quantum gate sequences for multi-qubit GHZ states without encoding any knowledge of quantum physics in the agent. The design of our framework is rather general and can be employed with other DRL architectures or optimization methods to study gate synthesis and compilation for many quantum states.
With the rapid development of quantum computing, the variational quantum algorithms capitalize on the classical optimizer and parametrized quantum circuit to provide outperformance on specific tasks such as combinatorial optimization problems. However, the performance of these hybrid quantum-classical algorithms heavily relies on the design of quantum circuit architecture. Being restricted by the noise of the near-term quantum device, how to trade off the computational power of quantum circuits and the noise of quantum gates is a challenging task for design circuit architecture. In this paper, we give a brief view of the recently proposed methods for quantum architecture search including the differentiable circuit search method, deep reinforcement learning based method, and evolutionary based methods.
With the evolution of technology, the need to solve complex computational problems like machine learning and deep learning has shot up. However, even the most powerful classical supercomputers find it difficult to execute these tasks. Advancements in quantum computing are leading researchers and tech-giants who strive for better quantum circuits to do machine learning tasks. Current works on Quantum Machine Learning (QML) ensure less memory consumption and reduced model parameters. However, it is strenuous to simulate the classical deep learning approach on existing quantum computing devices due to the inflexibility of Deep quantum circuits. Consequently, designing viable quantum algorithms for QML for noisy intermediate-scale quantum (NISQ) devices is essential. The proposed work aims to explore Variational Quantum Circuits (VQC) for Deep Q network-based Reinforcement Learning by remodeling the target network and experience replay into a representation of VQC. In addition, to the reduction in model parameters, quantum information encoding schemes are used to achieve better results than classical neural networks. VQCs are employed for policyselection and decision-making reinforcement learning by approximating the deep Q-value function with target network and experience replay.