Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2104.14539 · Physical Review X

Model-Free Quantum Control with Reinforcement Learning

Volodymyr Sivak, Alec Eickbusch, Henry C. Liu, Baptiste Royer, Ioannis Tsioutsios, Michel Devoret

Published Mar 28, 2022• 130 citations
arXivHTMLPDF

Abstract

A machine-learning agent learns how to control a quantum system---a key element of any quantum technology without any prior knowledge---by studying how a real quantum system responds to various actions.
DOI
10.1103/physrevx.12.011059

Related papers

Reinforcement Learning for Quantum Technology

Marin Bukov, Florian Marquardt

Many challenges arising in Quantum Technology can be successfully addressed using a set of machine learning algorithms collectively known as reinforcement learning (RL), based on adaptive decision-making through interaction with the quantum device. After a concise and intuitive introduction to RL aimed at a broad physics readership, we discuss the key ideas and core concepts in reinforcement learning with a particular focus on quantum systems. We then survey recent progress in RL in all relevant areas. We discuss state preparation in few- and many-body quantum systems, the design and optimization of high-fidelity quantum gates, and the automated construction of quantum circuits, including applications to variational quantum eigensolvers and architecture search. We further highlight the interactive capabilities of RL agents, emphasizing recent progress in quantum feedback control and quantum error correction, and briefly discuss quantum reinforcement learning as well as applications to quantum metrology. The review concludes with a discussion of open challenges -- such as scalability, interpretability, and integration with experimental platforms -- and outlines promising directions for future research. Throughout, we highlight experimental implementations that exemplify the increasing role of reinforcement learning in shaping the development of quantum technologies.

quant-pharXiv:2601.18953•Jan 28, 2026•0 citations

Control of Qubit Dynamics Using Reinforcement Learning

Dimitris Koutromanos, Dionisis Stefanatos, Emmanuel Paspalakis

The progress in machine learning during the last decade has had a considerable impact on many areas of science and technology, including quantum technology. This work explores the application of reinforcement learning (RL) methods to the quantum control problem of state transfer in a single qubit. The goal is to create an RL agent that learns an optimal policy and thus discovers optimal pulses to control the qubit. The most crucial step is to mathematically formulate the problem of interest as a Markov decision process (MDP). This enables the use of RL algorithms to solve the quantum control problem. Deep learning and the use of deep neural networks provide the freedom to employ continuous action and state spaces, offering the expressivity and generalization of the process. This flexibility helps to formulate the quantum state transfer problem as an MDP in several different ways. All the developed methodologies are applied to the fundamental problem of population inversion in a qubit. In most cases, the derived optimal pulses achieve fidelity equal to or higher than 0.9999, as required by quantum computing applications. The present methods can be easily extended to quantum systems with more energy levels and may be used for the efficient control of collections of qubits and to counteract the effect of noise, which are important topics for quantum sensing applications.

Information•May 11, 2024•11 citations

Reinforcement Learning in Different Phases of Quantum Control

Marin Bukov, Alexandre G. R. Day, Dries Sels +3 more

New experiments show that reinforcement learning algorithms, a cutting-edge technique for machine learning, can quickly and accurately learn to prepare a desired quantum state despite no knowledge of quantum mechanics.

arXiv:1705.00565•Physical Review X•Sep 27, 2018•333 citations

Model-Free Quantum Gate Design and Calibration Using Deep Reinforcement Learning

Omar Shindi, Qi Yu, Parth Girdhar +1 more

High-fidelity quantum gate design is important for various quantum technologies, such as quantum computation and quantum communication. Numerous control policies for quantum gate design have been proposed given a dynamical model of the quantum system of interest. However, a quantum system is often highly sensitive to noise, and obtaining its accurate modeling can be difficult for many practical applications. Thus, the control policy based on a quantum system model may be unpractical for quantum gate design. Also, quantum measurements collapse quantum states, which makes it challenging to obtain information through measurements during the control process. In this article, we propose a novel training framework using deep reinforcement learning for model-free quantum control. The proposed framework relies only on the measurement at the end of the control process and offers the ability to find the optimal control policy without access to quantum systems during the learning process. The effectiveness of the proposed technique is numerically demonstrated for model-free quantum gate design and quantum gate calibration using off-policy reinforcement learning algorithms.

arXiv:2302.02371•IEEE Transactions on Artificial Intelligence•Feb 8, 2023•16 citations

Polarization Drift Compensation for Quantum Key Distribution Using Machine Learning

Pavel A. Kupriyanov, Nikita Rudavin, David Kagramanyan +3 more

Abstract In various applications of optical communications, such as quantum key distribution (QKD) systems, the task of polarization control in optical fiber arises. A polarization controller (PC) on the receiver side is used to solve this problem. In our work, we investigate two machine learning approaches to polarization control: supervised learning (SL) and reinforcement learning (RL). We generalised analytical solution of the polarization control problem using SL-approach. Supervised learning algorithm was trained on simulations and then was validated in experimental setup. We compared supervised approach with analytical solution. The advantage of RL approach based on the capability of approximating nonlinear effects related to the imperfections of detection process. For the effective operation of polarization control algorithms, knowledge of the parameters of the PC is required. Reinforcement learning agent also eliminates control hardware calibration procedures, since the agent recognize necessary system parameters based on the experience of interacting with the environment. RL-agent was firstly pretrained on simulations and then was fine-tuned on the practical QKD system. We demonstrated that RL-agent’s tuning provides the 10% quantum bit error rate (QBER) on our setup, and converges in 10 steps.

Physics of Particles and Nuclei•Oct 25, 2025•1 citation

Reinforcement Learning for Quantum Metrology via Quantum Control

Seyed Shakib Vedaie, Pantita Palittapongarnpim, Barry C. Sanders

We develop reinforcement learning as a tool for classical and quantum control, which we treat in a unified framework. Our reinforcement-learning approach yields robust quantum metrology policies that beat the standard quantum limit.

IEEE/LEOS Summer Topical Meetings•Jul 1, 2018•7 citations
Many challenges arising in Quantum Technology can be successfully addressed using a set of machine learning algorithms collectively known as reinforcement learning (RL), based on adaptive decision-making through interaction with the quantum device. After a concise and intuitive introduction to RL aimed at a broad physics readership, we discuss the key ideas and core concepts in reinforcement learning with a particular focus on quantum systems. We then survey recent progress in RL in all relevant areas. We discuss state preparation in few- and many-body quantum systems, the design and optimization of high-fidelity quantum gates, and the automated construction of quantum circuits, including applications to variational quantum eigensolvers and architecture search. We further highlight the interactive capabilities of RL agents, emphasizing recent progress in quantum feedback control and quantum error correction, and briefly discuss quantum reinforcement learning as well as applications to quantum metrology. The review concludes with a discussion of open challenges -- such as scalability, interpretability, and integration with experimental platforms -- and outlines promising directions for future research. Throughout, we highlight experimental implementations that exemplify the increasing role of reinforcement learning in shaping the development of quantum technologies.
The progress in machine learning during the last decade has had a considerable impact on many areas of science and technology, including quantum technology. This work explores the application of reinforcement learning (RL) methods to the quantum control problem of state transfer in a single qubit. The goal is to create an RL agent that learns an optimal policy and thus discovers optimal pulses to control the qubit. The most crucial step is to mathematically formulate the problem of interest as a Markov decision process (MDP). This enables the use of RL algorithms to solve the quantum control problem. Deep learning and the use of deep neural networks provide the freedom to employ continuous action and state spaces, offering the expressivity and generalization of the process. This flexibility helps to formulate the quantum state transfer problem as an MDP in several different ways. All the developed methodologies are applied to the fundamental problem of population inversion in a qubit. In most cases, the derived optimal pulses achieve fidelity equal to or higher than 0.9999, as required by quantum computing applications. The present methods can be easily extended to quantum systems with more energy levels and may be used for the efficient control of collections of qubits and to counteract the effect of noise, which are important topics for quantum sensing applications.
High-fidelity quantum gate design is important for various quantum technologies, such as quantum computation and quantum communication. Numerous control policies for quantum gate design have been proposed given a dynamical model of the quantum system of interest. However, a quantum system is often highly sensitive to noise, and obtaining its accurate modeling can be difficult for many practical applications. Thus, the control policy based on a quantum system model may be unpractical for quantum gate design. Also, quantum measurements collapse quantum states, which makes it challenging to obtain information through measurements during the control process. In this article, we propose a novel training framework using deep reinforcement learning for model-free quantum control. The proposed framework relies only on the measurement at the end of the control process and offers the ability to find the optimal control policy without access to quantum systems during the learning process. The effectiveness of the proposed technique is numerically demonstrated for model-free quantum gate design and quantum gate calibration using off-policy reinforcement learning algorithms.
Abstract In various applications of optical communications, such as quantum key distribution (QKD) systems, the task of polarization control in optical fiber arises. A polarization controller (PC) on the receiver side is used to solve this problem. In our work, we investigate two machine learning approaches to polarization control: supervised learning (SL) and reinforcement learning (RL). We generalised analytical solution of the polarization control problem using SL-approach. Supervised learning algorithm was trained on simulations and then was validated in experimental setup. We compared supervised approach with analytical solution. The advantage of RL approach based on the capability of approximating nonlinear effects related to the imperfections of detection process. For the effective operation of polarization control algorithms, knowledge of the parameters of the PC is required. Reinforcement learning agent also eliminates control hardware calibration procedures, since the agent recognize necessary system parameters based on the experience of interacting with the environment. RL-agent was firstly pretrained on simulations and then was fine-tuned on the practical QKD system. We demonstrated that RL-agent’s tuning provides the 10% quantum bit error rate (QBER) on our setup, and converges in 10 steps.