Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2406.07225 · npj Quantum Information

Meta-learning assisted robust control of universal quantum gates with uncertainties

Shihui Zhang, Zibo Miao, Yu Pan, Sibo Tao, Yu Chen

Published May 19, 2025• 5 citations
arXivHTMLPDF

Abstract

Achieving high-fidelity quantum gates is crucial for reliable quantum computing. However, decoherence and control pulse imperfections pose significant challenges in realizing the theoretical fidelity of quantum gates in practical systems. To address these challenges, we propose the meta-reinforcement learning quantum control algorithm (metaQctrl), which leverages a two-layer learning framework to enhance robustness and fidelity. The inner reinforcement learning network focuses on decision making for specific optimization problems, while the outer meta-learning network adapts to varying environments and provides feedback to the inner network. Our comparative analysis regarding the realization of universal quantum gates demonstrates that metaQctrl achieves higher fidelity with fewer control pulses than conventional methods in the presence of uncertainties. These results can contribute to the exploration of the quantum speed limit and facilitate the implementation of quantum circuits with system imperfections involved.

DOI
10.1038/s41534-025-01034-9

Related papers

A Generic and Robust Agent to Accomplish Quantum Control Tasks

S Zhang, Zibo Miao, Qixiang Zhang +1 more

In view of inevitable uncertainties or disturbances in quantum systems, efficient and systematic numerical methods for robust control design are of significant importance. Although reinforcement learning has recently been applied in the field of quantum control, completing quantum control tasks in practice is always challenging due to the lack of data from real-world environments. In this paper, a generic and robust agent can be constructed catering to system imperfections by applying a curriculum meta-reinforcement learning quantum control (CMQC) approach. The proposed approach incorporates an objective module that can break down a complex quantum control objective into multiple sub-objectives using an exponential decay strategy, enabling the agent to gradually learn to solve the final goal through experience transfer and knowledge consolidation. Furthermore, a meta module is employed to achieve adaptation to environmental imperfections. This allows the agent to adjust its strategy in real time, obtaining strong robustness even in the presence of uncertainties. The superiority of CMQC is demonstrated in robust control problems regarding state transfer in a two-level quantum system and realization of the$R_{x}(\pi)$gate, with reduced computational cost and improved accuracy achieved. Our results pave the way towards more reliable and secure quantum information processing with uncertainties involved.

IEEE Transactions on Emerging Topics in Computational Intelligence•Feb 12, 2026•0 citations

Reinforcement Learning for Robust Calibration of Multi-Qudit Quantum Gates

Amine Jaouadi, Sahel Ashhab

Higher-dimensional quantum systems, such as qudits, offer architectural and algorithmic advantages over qubits, but their increased spectral crowding and limited controllability render high-fidelity quantum gates particularly challenging. We propose a hybrid optimization framework that integrates optimal control theory methods with contextual deep reinforcement learning to achieve robust controlled-phase gates on two qutrits. Optimal control is first used to design high-fidelity control pulses for a nominal system model. Reinforcement learning is then employed as a calibration stage that learns small residual corrections to these pulses in the presence of static model mismatch, thereby preserving good gate performance under realistic parameter uncertainties. By learning structured, low-dimensional residual corrections conditioned on device-specific parameter variations, reinforcement learning enhances the transfer robustness of nominally optimal but parameter-sensitive control solutions across ensembles of devices. Crucially, the reinforcement learning step in our framework does not compete with the optimal control step but provides the adaptability required for realistic hardware, systematically reducing the sensitivity to parameter fluctuations. Our results establish reinforcement learning as a practical and scalable ingredient for robust calibration of quantum gates in high-dimensional systems.

quant-pharXiv:2604.19990•Physical Review A•Apr 23, 2026•1 citation

Achieving fast and robust perfect entangling gates via reinforcement learning

Leander Grech, Matthias G. Krauss, Mirko Consiglio +4 more

Noisy intermediate-scale quantum computers hold the promise of tackling complex and otherwise intractable computational challenges through the massive parallelism offered by qubits. Central to realizing the potential of quantum computing are perfect entangling (PE) two-qubit gates, which serve as a critical building block for universal quantum computation. In the context of quantum optimal control, shaping electromagnetic pulses to drive quantum gates is crucial for pushing gate performance toward theoretical limits. In this work, we leverage reinforcement learning (RL) techniques to discover near-optimal pulse shapes that yield PE gates. A collection of RL agents is trained within robust simulation environments, enabling the identification of effective control strategies even under noisy conditions. Selected agents are then validated on higher-fidelity simulations, illustrating how RL-based methods can reduce calibration overhead when compared to quantum optimal control techniques. Furthermore, the RL approach is hardware agnostic with the potential for broad applicability across various quantum computing platforms.

quant-pharXiv:2511.07076•Quantum Science and Technology•Nov 11, 2025•2 citations

Adaptive Quantum Control via Reinforcement Learning

Jincheng Zhang

This paper investigates the application of reinforcement learning (RL) for adaptive quantum control. Traditional quantum control methods often rely on pre-designed pulse shapes optimized for specific scenarios, lacking adaptability to variations in system parameters or environmental noise. This work proposes a novel framework where an RL agent learns to dynamically adjust quantum control pulses in real-time, maximizing the fidelity of quantum operations. The agent receives feedback from the quantum system, typically measured through state variables, and utilizes this information to optimize the control pulse sequence. This adaptive approach addresses the limitations of static control schemes and promises enhanced robustness and performance in complex quantum systems. The core claim centers on utilizing reinforcement learning to design optimal quantum control pulses. The central mechanism involves a trained controller dynamically adjusting pulses based on system feedback. The presented methodology offers a new approach to quantum control, particularly relevant in noisy environments and systems with parameter variations. The research demonstrates the potential of RL for achieving superior quantum control outcomes compared to conventional techniques. ---

•Sep 4, 2026•0 citations

Quantum Gate Control with State Representation for Deep Reinforcement Learning

Yuanjing Zhang, Tao Shang, Chenyi Zhang +1 more

The extreme sensitivity of contemporary hardware to noise, manufacturing variability, and imperfect quantum logic gates are key factors that limit hardware to reliably perform quantum computation at scale. The use of reinforcement learning assisted control techniques for system dynamics optimization in quantum gate control can significantly improve hardware performance and downstream computing power. However, con-trol field noise and Hamiltonian parameter uncertainty can lead to significant deviations from the target quantum gate. As a result, quantum gates lack the generalization ability to the quantum environment, and existing reinforcement learning assisted for quantum state preparation is not suitable for quantum gate control. In this paper, we design QcontrolSR, a state representation for reinforcement learning method, enabling quantum gate control with enhanced generalization ability. It requires no knowledge of a specific Hamiltonian model of the system, or its underlying unknown process. We introduce the state representation of quantum observations and show through demonstrations that QcontrolSR-optimized quantum gate control is insensitive to driving noise of the typical strength in practice. We show that$R_{x}(\pi/2)$gate implemented using QcontrolSR can maintain fidelity greater than 0.95 and 0.99 on dynamical quantum stochastic system. The regions with fidelity greater than 0.99 and 0.999 are 2 and 3 times higher than the model-optimized Quantum gate control, respectively.

International Conference on Quantum Communications, Networking, and Computing (QCNC)•Jul 1, 2024•2 citations

Enhancement of Machine Learning for Adaptive Quantum Computing Control: The Optimization Performance and Prevention of Real Time Error

V. Saravanan, Ganesan M, R. Balasubramaniyan +3 more

Adaptive quantum computing control is important for the stability and efficiency of quantum systems, especially in the presence of dynamic environmental noise and hardware fluctuations. We present a unified strategy for machine learning (ML) techniques to improve adaptive quantum control in two main directions: optimization speed and out-of-sample error. Here, we propose a hybrid learning method combining reinforcement learning (RL), deep neural networks (DNNs), and quantum-inspired models to actively and adaptively update quantum gate parameters and error mitigation strategies on the fly. Embedding of quantum noise models directly into the learning allows the system to predict and correct for decoherence, gate errors and measurement inaccuracy before they affect computational fidelity. Using extensive simulations as well as experimental validation on noisy intermediate-scale quantum (NISQ) processors, our improved ML model achieves a substantially higher fidelity and robustness compared to standard model-free and static control approaches. We introduce a novel feedback-loop mechanism based on online learning algorithms enabling the system to adjust for changing noise profiles and hardware drift without retraining. The optimization part uses metaheuristic methods to quickly converge to control parameters that perform well, and the error prevention mechanism features anomaly detection and prediction correction layers to minimize the effects of cumulative decoherence. The results demonstrate that our adaptive control framework can be used to not only speed up the convergence in training quantum algorithms, but also sustain the performance of gates against error at a variety of error rates with the reduction of the real-time impact of the error up to 35 %. This work highlights the promise of machine learningaugmented quantum control for improving reliability and scalability in quantum computing and serves as a stepping stone for future incorporation with fault-tolerant designs.

International Conference on Electronics and Computing, Communication Networking Automation Technologies (ICEC2NT)•Sep 3, 2025•2 citations
Achieving high-fidelity quantum gates is crucial for reliable quantum computing. However, decoherence and control pulse imperfections pose significant challenges in realizing the theoretical fidelity of quantum gates in practical systems. To address these challenges, we propose the meta-reinforcement learning quantum control algorithm (metaQctrl), which leverages a two-layer learning framework to enhance robustness and fidelity. The inner reinforcement learning network focuses on decision making for specific optimization problems, while the outer meta-learning network adapts to varying environments and provides feedback to the inner network. Our comparative analysis regarding the realization of universal quantum gates demonstrates that metaQctrl achieves higher fidelity with fewer control pulses than conventional methods in the presence of uncertainties. These results can contribute to the exploration of the quantum speed limit and facilitate the implementation of quantum circuits with system imperfections involved.
In view of inevitable uncertainties or disturbances in quantum systems, efficient and systematic numerical methods for robust control design are of significant importance. Although reinforcement learning has recently been applied in the field of quantum control, completing quantum control tasks in practice is always challenging due to the lack of data from real-world environments. In this paper, a generic and robust agent can be constructed catering to system imperfections by applying a curriculum meta-reinforcement learning quantum control (CMQC) approach. The proposed approach incorporates an objective module that can break down a complex quantum control objective into multiple sub-objectives using an exponential decay strategy, enabling the agent to gradually learn to solve the final goal through experience transfer and knowledge consolidation. Furthermore, a meta module is employed to achieve adaptation to environmental imperfections. This allows the agent to adjust its strategy in real time, obtaining strong robustness even in the presence of uncertainties. The superiority of CMQC is demonstrated in robust control problems regarding state transfer in a two-level quantum system and realization of theRx(π)R_{x}(\pi)Rx​(π)gate, with reduced computational cost and improved accuracy achieved. Our results pave the way towards more reliable and secure quantum information processing with uncertainties involved.
Higher-dimensional quantum systems, such as qudits, offer architectural and algorithmic advantages over qubits, but their increased spectral crowding and limited controllability render high-fidelity quantum gates particularly challenging. We propose a hybrid optimization framework that integrates optimal control theory methods with contextual deep reinforcement learning to achieve robust controlled-phase gates on two qutrits. Optimal control is first used to design high-fidelity control pulses for a nominal system model. Reinforcement learning is then employed as a calibration stage that learns small residual corrections to these pulses in the presence of static model mismatch, thereby preserving good gate performance under realistic parameter uncertainties. By learning structured, low-dimensional residual corrections conditioned on device-specific parameter variations, reinforcement learning enhances the transfer robustness of nominally optimal but parameter-sensitive control solutions across ensembles of devices. Crucially, the reinforcement learning step in our framework does not compete with the optimal control step but provides the adaptability required for realistic hardware, systematically reducing the sensitivity to parameter fluctuations. Our results establish reinforcement learning as a practical and scalable ingredient for robust calibration of quantum gates in high-dimensional systems.
Noisy intermediate-scale quantum computers hold the promise of tackling complex and otherwise intractable computational challenges through the massive parallelism offered by qubits. Central to realizing the potential of quantum computing are perfect entangling (PE) two-qubit gates, which serve as a critical building block for universal quantum computation. In the context of quantum optimal control, shaping electromagnetic pulses to drive quantum gates is crucial for pushing gate performance toward theoretical limits. In this work, we leverage reinforcement learning (RL) techniques to discover near-optimal pulse shapes that yield PE gates. A collection of RL agents is trained within robust simulation environments, enabling the identification of effective control strategies even under noisy conditions. Selected agents are then validated on higher-fidelity simulations, illustrating how RL-based methods can reduce calibration overhead when compared to quantum optimal control techniques. Furthermore, the RL approach is hardware agnostic with the potential for broad applicability across various quantum computing platforms.
This paper investigates the application of reinforcement learning (RL) for adaptive quantum control. Traditional quantum control methods often rely on pre-designed pulse shapes optimized for specific scenarios, lacking adaptability to variations in system parameters or environmental noise. This work proposes a novel framework where an RL agent learns to dynamically adjust quantum control pulses in real-time, maximizing the fidelity of quantum operations. The agent receives feedback from the quantum system, typically measured through state variables, and utilizes this information to optimize the control pulse sequence. This adaptive approach addresses the limitations of static control schemes and promises enhanced robustness and performance in complex quantum systems. The core claim centers on utilizing reinforcement learning to design optimal quantum control pulses. The central mechanism involves a trained controller dynamically adjusting pulses based on system feedback. The presented methodology offers a new approach to quantum control, particularly relevant in noisy environments and systems with parameter variations. The research demonstrates the potential of RL for achieving superior quantum control outcomes compared to conventional techniques. ---
The extreme sensitivity of contemporary hardware to noise, manufacturing variability, and imperfect quantum logic gates are key factors that limit hardware to reliably perform quantum computation at scale. The use of reinforcement learning assisted control techniques for system dynamics optimization in quantum gate control can significantly improve hardware performance and downstream computing power. However, con-trol field noise and Hamiltonian parameter uncertainty can lead to significant deviations from the target quantum gate. As a result, quantum gates lack the generalization ability to the quantum environment, and existing reinforcement learning assisted for quantum state preparation is not suitable for quantum gate control. In this paper, we design QcontrolSR, a state representation for reinforcement learning method, enabling quantum gate control with enhanced generalization ability. It requires no knowledge of a specific Hamiltonian model of the system, or its underlying unknown process. We introduce the state representation of quantum observations and show through demonstrations that QcontrolSR-optimized quantum gate control is insensitive to driving noise of the typical strength in practice. We show thatRx(π/2)R_{x}(\pi/2)Rx​(π/2)gate implemented using QcontrolSR can maintain fidelity greater than 0.95 and 0.99 on dynamical quantum stochastic system. The regions with fidelity greater than 0.99 and 0.999 are 2 and 3 times higher than the model-optimized Quantum gate control, respectively.
Adaptive quantum computing control is important for the stability and efficiency of quantum systems, especially in the presence of dynamic environmental noise and hardware fluctuations. We present a unified strategy for machine learning (ML) techniques to improve adaptive quantum control in two main directions: optimization speed and out-of-sample error. Here, we propose a hybrid learning method combining reinforcement learning (RL), deep neural networks (DNNs), and quantum-inspired models to actively and adaptively update quantum gate parameters and error mitigation strategies on the fly. Embedding of quantum noise models directly into the learning allows the system to predict and correct for decoherence, gate errors and measurement inaccuracy before they affect computational fidelity. Using extensive simulations as well as experimental validation on noisy intermediate-scale quantum (NISQ) processors, our improved ML model achieves a substantially higher fidelity and robustness compared to standard model-free and static control approaches. We introduce a novel feedback-loop mechanism based on online learning algorithms enabling the system to adjust for changing noise profiles and hardware drift without retraining. The optimization part uses metaheuristic methods to quickly converge to control parameters that perform well, and the error prevention mechanism features anomaly detection and prediction correction layers to minimize the effects of cumulative decoherence. The results demonstrate that our adaptive control framework can be used to not only speed up the convergence in training quantum algorithms, but also sustain the performance of gates against error at a variety of error rates with the reduction of the real-time impact of the error up to 35 %. This work highlights the promise of machine learningaugmented quantum control for improving reliability and scalability in quantum computing and serves as a stepping stone for future incorporation with fault-tolerant designs.