Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2408.11328 · IEEE Transactions on Quantum Engineering

Fast State Stabilization Using Deep Reinforcement Learning for Measurement-Based Quantum Feedback Control

Chunxiang Song, Yanan Liu, Daoyi Dong, Hidehiro Yonezawa

Published Jan 1, 2025• 2 citations
arXivHTMLPDF

Abstract

The stabilization of quantum states is a fundamental problem for realizing various quantum technologies. Measurement-based-feedback strategies have demonstrated powerful performance, and the construction of quantum control signals using measurement information has attracted great interest. However, the interaction between quantum systems and the environment is inevitable, especially when measurements are introduced, which leads to decoherence. To mitigate decoherence, it is desirable to stabilize quantum systems faster, thereby reducing the time of interaction with the environment. In this paper, we utilize information obtained from measurement and apply deep reinforcement learning (DRL) algorithms, without explicitly constructing specific complex measurement-control mappings, to rapidly drive random initial quantum state to the target state. The proposed DRL algorithm has the ability to speed up the convergence to a target state, which shortens the interaction between quantum systems and their environments to protect coherence. Simulations are performed on two-qubit and three-qubit systems, and the results show that our algorithm can successfully stabilize random initial quantum system to the target entangled state, with a convergence time faster than traditional methods such as Lyapunov feedback control and several DRL algorithms with different reward functions. Moreover, it exhibits robustness against imperfect measurements and delays in system evolution.

DOI
10.1109/tqe.2025.3606123

Related papers

Control Hamiltonian selection for quantum state stabilization using deep reinforcement learning

Chunxiang Song, Yanan Liu, Daoyi Dong +1 more

Quantum state stabilization is a pivotal element in the realm of quantum control, forming the bedrock for various quantum tasks. To achieve the stabilization of a quantum state, it is imperative to formulate effective control channels (represented by control Hamiltonians) and devise the appropriate control signals. In this study, we introduce a novel approach, the selection of control Hamiltonians through Deep reinforcement learning (SCH-DRL), to address the challenge of control Hamiltonian selection in quantum control. Deep reinforcement learning (DRL) is employed to generate control signals corresponding to control Hamiltonians, and SCH-DRL utilizes these control signals to recognize a set of simple and efficient control Hamiltonians, depending on different target states. This approach not only provides a method for control Hamiltonian selection in quantum state stabilization but also unveils the untapped potential of DRL for a broad spectrum of applications in the field of quantum information. Through applications in two-qubit and three-qubit scenarios, we demonstrate how the SCH-DRL method adeptly selects the quantity of control Hamiltonians for achieving the desired stability of quantum states.

Chinese Control Conference (CCC)•Jul 28, 2024•0 citations

Measurement-Based Feedback Quantum Control with Deep Reinforcement Learning for a Double-Well Nonlinear Potential

Sangkha Borah, Bijita Sarma, Michael J. Kewming +2 more

Closed loop quantum control uses measurement to control the dynamics of a quantum system to achieve either a desired target state or target dynamics. In the case when the quantum Hamiltonian is quadratic in x and p, there are known optimal control techniques to drive the dynamics toward particular states, e.g., the ground state. However, for nonlinear Hamiltonian such control techniques often fail. We apply deep reinforcement learning (DRL), where an artificial neural agent explores and learns to control the quantum evolution of a highly nonlinear system (double well), driving the system toward the ground state with high fidelity. We consider a DRL strategy which is particularly motivated by experiment where the quantum system is continuously but weakly measured. This measurement is then fed back to the neural agent and used for training. We show that the DRL can effectively learn counterintuitive strategies to cool the system to a nearly pure "cat" state, which has a high overlap fidelity with the true ground state.

arXiv:2104.11856•Physical Review Letters•Nov 2, 2021•77 citations

Critical States Preparation With Deep Reinforcement Learning

Jia-Wen Yu, Yi-Ming Yu, Ke-Xiong Yan +4 more

The fast and efficient preparation of quantum critical states is a challenging yet crucial task for various quantum technologies. This difficulty is most particularly for systems near a quantum phase transition, where the closure of the energy gap fundamentally limits the timescale of adiabatic processes and thus precludes rapid state preparation. We propose a framework using deep reinforcement learning (DRL) to rapidly prepare quantum critical states, with broad extendibility to light-matter interaction systems. Specifically, a DRL agent optimizes a set of time-dependent control Hamiltonians to drive the system from an initial noncritical state to a target critical state within a finite time and over experimentally accessible parameter ranges. As a concrete application, we focus on the quantum Rabi model. The DRL-optimized time-dependent control Hamiltonian yield a final state with high-fidelity ($>0.999$) to the target critical state. The protocol can be readily extended to other quantum critical systems described by light-matter interaction models, such as quantum Dicke model. This investigation provides a powerful new framework for preparing and manipulating quantum critical states.

quant-pharXiv:2603.09135•Mar 11, 2026•0 citations

Memory-Based Deep Reinforcement Learning for Quantum Control With Partial Observations

Haixu Yu, Qi Yu, Chunlin Chen +1 more

Deep reinforcement learning (DRL) has gained increasing attention in quantum physics, especially for quantum control problems, as it effectively handles high dimensionality and complex dynamics. However, many existing DRL-based quantum control methods assume full observability of quantum states, which tends to be impractical due to the massive state copies required for precise quantum measurements. To address this, we model quantum control under partial observations and introduce a memory-based DRL (MDRL) method that efficiently handles such scenarios. The proposed MDRL comprises two key components: a memory-based exploration strategy and a memory-based reward scheme. Specifically, the agent is equipped with a biology-inspired brain to memorize information derived from partial observations, including whether an episode is successful and the number of steps spent on a successful episode. The exploration strategy leverages the memorized information to guide interactions with the quantum system, while the reward scheme assigns appropriate rewards, together enabling the agent to learn an effective control strategy. The effectiveness of MDRL is verified by three examples, i.e., one-qubit state control, two-qubit state control, and$T_{x}$gate design. Numerical results demonstrate that MDRL outperforms several representative DRL algorithms for quantum control.

IEEE Transactions on Emerging Topics in Computational Intelligence•Nov 28, 2025•1 citation

Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements

Riccardo Porotti, Antoine Essig, Benjamin Huard +1 more

Quantum control has been of increasing interest in recent years, e.g. for tasks like state initialization and stabilization. Feedback-based strategies are particularly powerful, but also hard to find, due to the exponentially increased search space. Deep reinforcement learning holds great promise in this regard. It may provide new answers to difficult questions, such as whether nonlinear measurements can compensate for linear, constrained control. Here we show that reinforcement learning can successfully discover such feedback strategies, without prior knowledge. We illustrate this for state preparation in a cavity subject to quantum-non-demolition detection of photon number, with a simple linear drive as control. Fock states can be produced and stabilized at very high fidelity. It is even possible to reach superposition states, provided the measurement rates for different Fock states can be controlled as well.

arXiv:2107.08816•Quantum•Jun 28, 2022•70 citations

Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system

Kevin Reuer, Jonas Landgraf, Thomas Fösel +10 more

To realize the full potential of quantum technologies, finding good strategies to control quantum information processing devices in real time becomes increasingly important. Usually these strategies require a precise understanding of the device itself, which is generally not available. Model-free reinforcement learning circumvents this need by discovering control strategies from scratch without relying on an accurate description of the quantum system. Furthermore, important tasks like state preparation, gate teleportation and error correction need feedback at time scales much shorter than the coherence time, which for superconducting circuits is in the microsecond range. Developing and training a deep reinforcement learning agent able to operate in this real-time feedback regime has been an open challenge. Here, we have implemented such an agent in the form of a latency-optimized deep neural network on a field-programmable gate array (FPGA). We demonstrate its use to efficiently initialize a superconducting qubit into a target state. To train the agent, we use model-free reinforcement learning that is based solely on measurement data. We study the agent's performance for strong and weak measurements, and for three-level readout, and compare with simple strategies based on thresholding. This demonstration motivates further research towards adoption of reinforcement learning for real-time feedback control of quantum devices and more generally any physical system requiring learnable low-latency feedback control.

arXiv:2210.16715•Oct 30, 2022•3 citations
The stabilization of quantum states is a fundamental problem for realizing various quantum technologies. Measurement-based-feedback strategies have demonstrated powerful performance, and the construction of quantum control signals using measurement information has attracted great interest. However, the interaction between quantum systems and the environment is inevitable, especially when measurements are introduced, which leads to decoherence. To mitigate decoherence, it is desirable to stabilize quantum systems faster, thereby reducing the time of interaction with the environment. In this paper, we utilize information obtained from measurement and apply deep reinforcement learning (DRL) algorithms, without explicitly constructing specific complex measurement-control mappings, to rapidly drive random initial quantum state to the target state. The proposed DRL algorithm has the ability to speed up the convergence to a target state, which shortens the interaction between quantum systems and their environments to protect coherence. Simulations are performed on two-qubit and three-qubit systems, and the results show that our algorithm can successfully stabilize random initial quantum system to the target entangled state, with a convergence time faster than traditional methods such as Lyapunov feedback control and several DRL algorithms with different reward functions. Moreover, it exhibits robustness against imperfect measurements and delays in system evolution.
Quantum state stabilization is a pivotal element in the realm of quantum control, forming the bedrock for various quantum tasks. To achieve the stabilization of a quantum state, it is imperative to formulate effective control channels (represented by control Hamiltonians) and devise the appropriate control signals. In this study, we introduce a novel approach, the selection of control Hamiltonians through Deep reinforcement learning (SCH-DRL), to address the challenge of control Hamiltonian selection in quantum control. Deep reinforcement learning (DRL) is employed to generate control signals corresponding to control Hamiltonians, and SCH-DRL utilizes these control signals to recognize a set of simple and efficient control Hamiltonians, depending on different target states. This approach not only provides a method for control Hamiltonian selection in quantum state stabilization but also unveils the untapped potential of DRL for a broad spectrum of applications in the field of quantum information. Through applications in two-qubit and three-qubit scenarios, we demonstrate how the SCH-DRL method adeptly selects the quantity of control Hamiltonians for achieving the desired stability of quantum states.
Closed loop quantum control uses measurement to control the dynamics of a quantum system to achieve either a desired target state or target dynamics. In the case when the quantum Hamiltonian is quadratic in x and p, there are known optimal control techniques to drive the dynamics toward particular states, e.g., the ground state. However, for nonlinear Hamiltonian such control techniques often fail. We apply deep reinforcement learning (DRL), where an artificial neural agent explores and learns to control the quantum evolution of a highly nonlinear system (double well), driving the system toward the ground state with high fidelity. We consider a DRL strategy which is particularly motivated by experiment where the quantum system is continuously but weakly measured. This measurement is then fed back to the neural agent and used for training. We show that the DRL can effectively learn counterintuitive strategies to cool the system to a nearly pure "cat" state, which has a high overlap fidelity with the true ground state.
The fast and efficient preparation of quantum critical states is a challenging yet crucial task for various quantum technologies. This difficulty is most particularly for systems near a quantum phase transition, where the closure of the energy gap fundamentally limits the timescale of adiabatic processes and thus precludes rapid state preparation. We propose a framework using deep reinforcement learning (DRL) to rapidly prepare quantum critical states, with broad extendibility to light-matter interaction systems. Specifically, a DRL agent optimizes a set of time-dependent control Hamiltonians to drive the system from an initial noncritical state to a target critical state within a finite time and over experimentally accessible parameter ranges. As a concrete application, we focus on the quantum Rabi model. The DRL-optimized time-dependent control Hamiltonian yield a final state with high-fidelity (>0.999>0.999>0.999) to the target critical state. The protocol can be readily extended to other quantum critical systems described by light-matter interaction models, such as quantum Dicke model. This investigation provides a powerful new framework for preparing and manipulating quantum critical states.
Deep reinforcement learning (DRL) has gained increasing attention in quantum physics, especially for quantum control problems, as it effectively handles high dimensionality and complex dynamics. However, many existing DRL-based quantum control methods assume full observability of quantum states, which tends to be impractical due to the massive state copies required for precise quantum measurements. To address this, we model quantum control under partial observations and introduce a memory-based DRL (MDRL) method that efficiently handles such scenarios. The proposed MDRL comprises two key components: a memory-based exploration strategy and a memory-based reward scheme. Specifically, the agent is equipped with a biology-inspired brain to memorize information derived from partial observations, including whether an episode is successful and the number of steps spent on a successful episode. The exploration strategy leverages the memorized information to guide interactions with the quantum system, while the reward scheme assigns appropriate rewards, together enabling the agent to learn an effective control strategy. The effectiveness of MDRL is verified by three examples, i.e., one-qubit state control, two-qubit state control, andTxT_{x}Tx​gate design. Numerical results demonstrate that MDRL outperforms several representative DRL algorithms for quantum control.
Quantum control has been of increasing interest in recent years, e.g. for tasks like state initialization and stabilization. Feedback-based strategies are particularly powerful, but also hard to find, due to the exponentially increased search space. Deep reinforcement learning holds great promise in this regard. It may provide new answers to difficult questions, such as whether nonlinear measurements can compensate for linear, constrained control. Here we show that reinforcement learning can successfully discover such feedback strategies, without prior knowledge. We illustrate this for state preparation in a cavity subject to quantum-non-demolition detection of photon number, with a simple linear drive as control. Fock states can be produced and stabilized at very high fidelity. It is even possible to reach superposition states, provided the measurement rates for different Fock states can be controlled as well.
To realize the full potential of quantum technologies, finding good strategies to control quantum information processing devices in real time becomes increasingly important. Usually these strategies require a precise understanding of the device itself, which is generally not available. Model-free reinforcement learning circumvents this need by discovering control strategies from scratch without relying on an accurate description of the quantum system. Furthermore, important tasks like state preparation, gate teleportation and error correction need feedback at time scales much shorter than the coherence time, which for superconducting circuits is in the microsecond range. Developing and training a deep reinforcement learning agent able to operate in this real-time feedback regime has been an open challenge. Here, we have implemented such an agent in the form of a latency-optimized deep neural network on a field-programmable gate array (FPGA). We demonstrate its use to efficiently initialize a superconducting qubit into a target state. To train the agent, we use model-free reinforcement learning that is based solely on measurement data. We study the agent's performance for strong and weak measurements, and for three-level readout, and compare with simple strategies based on thresholding. This demonstration motivates further research towards adoption of reinforcement learning for real-time feedback control of quantum devices and more generally any physical system requiring learnable low-latency feedback control.