Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2203.00189 · New Journal of Physics

Efficient and robust entanglement generation with deep reinforcement learning for quantum metrology

Yuxiang Qiu, Min Zhuang, Jiahao Huang, Chaohong Lee

Published Jul 20, 2022• 19 citations
arXivHTMLPDF

Abstract

Abstract Quantum metrology exploits quantum resources and strategies to improve measurement precision of unknown parameters. One crucial issue is how to prepare a quantum entangled state suitable for high-precision measurement beyond the standard quantum limit. Here, we propose a scheme to optimize the state preparation pulse sequence to accelerate the one-axis twisting dynamics for entanglement generation with the aid of deep reinforcement learning (DRL). We consider the pulse train as a sequence of π /2 pulses along one axis or two orthogonal axes, and the operation is determined by maximizing the quantum Fisher information using DRL. Within a limited evolution time, the ultimate precision bounds of the prepared entangled states follow the Heisenberg-limited scalings. These states can also be used as the input states for Ramsey interferometry and the final measurement precisions still follow the Heisenberg-limited scalings. While the pulse train along only one axis is more simple and efficient, the scheme using pulse sequence along two orthogonal axes show better robustness against atom number difference between simulation and experiment. Our protocol with DRL is efficient and easy to be implemented in state-of-the-art experiments.

DOI
10.1088/1367-2630/ac8285

Related papers

Machine optimized quantum metrology of concurrent entanglement generation and sensing

Hongtao Huo, Min Zhuang, Jiahao Huang +1 more

Abstract Entanglement is one of the key ingredients for enhancing the measurement precision of quantum sensors. Generally, there is a trade-off between state preparation and sensing within a limited coherence time. To fully exploit temporal resources, concurrent entanglement generation and sensing with designed sequence of rotations are proposed. Based on twist-and-turn dynamics, modulated rotations along only one axis may be sufficient to drive the state to the optimal one for tiny estimated parameter. However, when the estimated parameter is not tiny, it may impact the evolved state and hence degrade the final measurement precision. Here, we introduce another modulated rotations along different axis and find out the optimal control sequences by means of machine optimization. The optimal measurement precision bounds become independent on the estimated parameter, which improves the dynamic range of the machine designed sensors. Particularly, by optimizing the interaction strength for different particle number and the time-modulated rotations along two different axes via machine optimization, the Heisenberg-limited precision scaling can be attained. Our work points out a way for designing optimized quantum-enhanced metrology protocols, which is promising for developing practical quantum sensors.

Quantum Science and Technology•Feb 3, 2022•11 citations

Extreme spin squeezing from deep reinforcement learning

Feng Chen, Junjie Chen, Ling-Na Wu +2 more

Spin squeezing (SS) is a recognized resource for realizing measurement precision beyond the standard quantum limit $\ensuremath{\propto}1/\sqrt{N}$. The rudimentary one-axis twisting (OAT) interaction can facilitate SS and has been realized in diverse experiments, but it cannot achieve extreme SS for precision at the Heisenberg limit $\ensuremath{\propto}1/N$. Aided by deep reinforcement learning (DRL), we discover size-independent universal rules for realizing nearly extreme SS with a OAT interaction using merely a handful of rotation pulses. More specifically, only six pairs of pulses are required for up to ${10}^{4}$ particles, while the time taken to reach extreme SS remains on the same order of the optimal OAT squeezing time, which makes our scheme viable for experiments that reported OAT squeezing. This Rapid Communication highlights the potential of DRL for controlled quantum dynamics.

arXiv:1909.12519•Physical Review A•Oct 15, 2019•27 citations

Deep Reinforcement Learning for quantum state preparation with noisy gates in the NISQ-era

Narvaez Hernandez, Roberto

Quantum computers promise significant computational advantages over classical computers for specific tasks. However, one of the challenges in the noisy intermediate-scale quantum (NISQ) era is the efficient compilation of quantum states and gates, which is crucial for the implementation of quantum algorithms. Given the high dimensionality of quantum systems, this compilation task is non-trivial. Reinforcement learning (RL) is a machine learning subfield focused on developing algorithms for decision-making in dynamic environments. An agent learns by interacting with its environment, how to act to optimize its performance on a certain task. Recently, the integration of deep learning has given rise to deep reinforcement learning (DRL), where deep neural networks approximate functions like value or policy, allowing agents to tackle high-dimensional and complex tasks with greater efficiency and success. Recently, deep reinforcement learning (DRL) has been proposed as a method to automate quantum compiling. In this thesis, we explore the application of RL for quantum state and unitary matrix synthesis, focusing on the use of two reinforcement learning algorithms Deep Q-Networks (DQN) and Proximal Policy Optimization (PPO). Our results indicate that DRL shows promise in generalizing the task of quantum unitary synthesis and quantum state preparation. However, the current state-of-the-art is still limited to working in the no-volume law entangled part of the Hilbert space.

•Sep 9, 2024•0 citations

Breaking adiabatic quantum control with deep learning

Yongcheng Ding, Yue Ban, José D. Martín‐Guerrero +3 more

In the noisy intermediate-scale quantum era, optimal digitized pulses are requisite for efficient quantum control. This goal is translated into dynamic programming, in which a deep reinforcement learning (DRL) agent is gifted. As a reference, shortcuts to adiabaticity (STA) provide analytical approaches to adiabatic speedup by pulse control. Here, we select the single-component control of qubits, resembling the ubiquitous two-level Landau-Zener problem for gate operation. We aim at obtaining fast and robust digital pulses by combining the STA and DRL algorithm. In particular, we find that DRL leads to robust digital quantum control with the operation time bounded by quantum speed limits dictated by STA. In addition, we demonstrate that robustness against systematic errors can be achieved by DRL without any input from STA. Our results introduce a general framework of digital quantum control, leading to a promising enhancement in quantum information processing.

arXiv:2009.04297•Physical Review A•Apr 9, 2021•49 citations

Deep reinforcement learning for universal quantum state preparation via dynamic pulse control

Run-Hong He, Rui Wang, Shen-Shuang Nie +3 more

Abstract Accurate and efficient preparation of quantum state is a core issue in building a quantum computer. In this paper, we investigate how to prepare a certain single- or two-qubit target state from arbitrary initial states in semiconductor double quantum dots with only a few discrete control pulses by leveraging the deep reinforcement learning. Our method is based on the training of the network over numerous preparing tasks. The results show that once the network is well trained, it works for any initial states in the continuous Hilbert space. Thus repeated training for new preparation tasks is avoided. Our scheme outperforms the traditional optimization approaches based on gradient with both the higher efficiency and the preparation quality in discrete control space. Moreover, we find that the control trajectories designed by our scheme are robust against stochastic fluctuations within certain thresholds, such as the charge and nuclear noises.

arXiv:2012.00326•EPJ Quantum Technology•Dec 1, 2021•26 citations

Critical States Preparation With Deep Reinforcement Learning

Jia-Wen Yu, Yi-Ming Yu, Ke-Xiong Yan +4 more

The fast and efficient preparation of quantum critical states is a challenging yet crucial task for various quantum technologies. This difficulty is most particularly for systems near a quantum phase transition, where the closure of the energy gap fundamentally limits the timescale of adiabatic processes and thus precludes rapid state preparation. We propose a framework using deep reinforcement learning (DRL) to rapidly prepare quantum critical states, with broad extendibility to light-matter interaction systems. Specifically, a DRL agent optimizes a set of time-dependent control Hamiltonians to drive the system from an initial noncritical state to a target critical state within a finite time and over experimentally accessible parameter ranges. As a concrete application, we focus on the quantum Rabi model. The DRL-optimized time-dependent control Hamiltonian yield a final state with high-fidelity ($>0.999$) to the target critical state. The protocol can be readily extended to other quantum critical systems described by light-matter interaction models, such as quantum Dicke model. This investigation provides a powerful new framework for preparing and manipulating quantum critical states.

quant-pharXiv:2603.09135•Mar 11, 2026•0 citations
Abstract Quantum metrology exploits quantum resources and strategies to improve measurement precision of unknown parameters. One crucial issue is how to prepare a quantum entangled state suitable for high-precision measurement beyond the standard quantum limit. Here, we propose a scheme to optimize the state preparation pulse sequence to accelerate the one-axis twisting dynamics for entanglement generation with the aid of deep reinforcement learning (DRL). We consider the pulse train as a sequence of π /2 pulses along one axis or two orthogonal axes, and the operation is determined by maximizing the quantum Fisher information using DRL. Within a limited evolution time, the ultimate precision bounds of the prepared entangled states follow the Heisenberg-limited scalings. These states can also be used as the input states for Ramsey interferometry and the final measurement precisions still follow the Heisenberg-limited scalings. While the pulse train along only one axis is more simple and efficient, the scheme using pulse sequence along two orthogonal axes show better robustness against atom number difference between simulation and experiment. Our protocol with DRL is efficient and easy to be implemented in state-of-the-art experiments.
Abstract Entanglement is one of the key ingredients for enhancing the measurement precision of quantum sensors. Generally, there is a trade-off between state preparation and sensing within a limited coherence time. To fully exploit temporal resources, concurrent entanglement generation and sensing with designed sequence of rotations are proposed. Based on twist-and-turn dynamics, modulated rotations along only one axis may be sufficient to drive the state to the optimal one for tiny estimated parameter. However, when the estimated parameter is not tiny, it may impact the evolved state and hence degrade the final measurement precision. Here, we introduce another modulated rotations along different axis and find out the optimal control sequences by means of machine optimization. The optimal measurement precision bounds become independent on the estimated parameter, which improves the dynamic range of the machine designed sensors. Particularly, by optimizing the interaction strength for different particle number and the time-modulated rotations along two different axes via machine optimization, the Heisenberg-limited precision scaling can be attained. Our work points out a way for designing optimized quantum-enhanced metrology protocols, which is promising for developing practical quantum sensors.
Spin squeezing (SS) is a recognized resource for realizing measurement precision beyond the standard quantum limit $\ensuremath{\propto}1/\sqrt{N}$. The rudimentary one-axis twisting (OAT) interaction can facilitate SS and has been realized in diverse experiments, but it cannot achieve extreme SS for precision at the Heisenberg limit $\ensuremath{\propto}1/N$. Aided by deep reinforcement learning (DRL), we discover size-independent universal rules for realizing nearly extreme SS with a OAT interaction using merely a handful of rotation pulses. More specifically, only six pairs of pulses are required for up to 104{10}^{4}104 particles, while the time taken to reach extreme SS remains on the same order of the optimal OAT squeezing time, which makes our scheme viable for experiments that reported OAT squeezing. This Rapid Communication highlights the potential of DRL for controlled quantum dynamics.
Quantum computers promise significant computational advantages over classical computers for specific tasks. However, one of the challenges in the noisy intermediate-scale quantum (NISQ) era is the efficient compilation of quantum states and gates, which is crucial for the implementation of quantum algorithms. Given the high dimensionality of quantum systems, this compilation task is non-trivial. Reinforcement learning (RL) is a machine learning subfield focused on developing algorithms for decision-making in dynamic environments. An agent learns by interacting with its environment, how to act to optimize its performance on a certain task. Recently, the integration of deep learning has given rise to deep reinforcement learning (DRL), where deep neural networks approximate functions like value or policy, allowing agents to tackle high-dimensional and complex tasks with greater efficiency and success. Recently, deep reinforcement learning (DRL) has been proposed as a method to automate quantum compiling. In this thesis, we explore the application of RL for quantum state and unitary matrix synthesis, focusing on the use of two reinforcement learning algorithms Deep Q-Networks (DQN) and Proximal Policy Optimization (PPO). Our results indicate that DRL shows promise in generalizing the task of quantum unitary synthesis and quantum state preparation. However, the current state-of-the-art is still limited to working in the no-volume law entangled part of the Hilbert space.
In the noisy intermediate-scale quantum era, optimal digitized pulses are requisite for efficient quantum control. This goal is translated into dynamic programming, in which a deep reinforcement learning (DRL) agent is gifted. As a reference, shortcuts to adiabaticity (STA) provide analytical approaches to adiabatic speedup by pulse control. Here, we select the single-component control of qubits, resembling the ubiquitous two-level Landau-Zener problem for gate operation. We aim at obtaining fast and robust digital pulses by combining the STA and DRL algorithm. In particular, we find that DRL leads to robust digital quantum control with the operation time bounded by quantum speed limits dictated by STA. In addition, we demonstrate that robustness against systematic errors can be achieved by DRL without any input from STA. Our results introduce a general framework of digital quantum control, leading to a promising enhancement in quantum information processing.
Abstract Accurate and efficient preparation of quantum state is a core issue in building a quantum computer. In this paper, we investigate how to prepare a certain single- or two-qubit target state from arbitrary initial states in semiconductor double quantum dots with only a few discrete control pulses by leveraging the deep reinforcement learning. Our method is based on the training of the network over numerous preparing tasks. The results show that once the network is well trained, it works for any initial states in the continuous Hilbert space. Thus repeated training for new preparation tasks is avoided. Our scheme outperforms the traditional optimization approaches based on gradient with both the higher efficiency and the preparation quality in discrete control space. Moreover, we find that the control trajectories designed by our scheme are robust against stochastic fluctuations within certain thresholds, such as the charge and nuclear noises.
The fast and efficient preparation of quantum critical states is a challenging yet crucial task for various quantum technologies. This difficulty is most particularly for systems near a quantum phase transition, where the closure of the energy gap fundamentally limits the timescale of adiabatic processes and thus precludes rapid state preparation. We propose a framework using deep reinforcement learning (DRL) to rapidly prepare quantum critical states, with broad extendibility to light-matter interaction systems. Specifically, a DRL agent optimizes a set of time-dependent control Hamiltonians to drive the system from an initial noncritical state to a target critical state within a finite time and over experimentally accessible parameter ranges. As a concrete application, we focus on the quantum Rabi model. The DRL-optimized time-dependent control Hamiltonian yield a final state with high-fidelity (>0.999>0.999>0.999) to the target critical state. The protocol can be readily extended to other quantum critical systems described by light-matter interaction models, such as quantum Dicke model. This investigation provides a powerful new framework for preparing and manipulating quantum critical states.