Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2406.05597 · Physical Review A

Optimal control of linear Gaussian quantum systems via quantum learning control

Yu-Hong Liu, Ye‐Xiong Zeng, Qing-Shou Tan, Daoyi Dong, Franco Nori, Jie‐Qiao Liao

Published Jun 6, 2024• 11 citations
arXivHTMLPDF

Abstract

Efficiently controlling linear Gaussian quantum (LGQ) systems is a significant task in both the study of fundamental quantum theory and the development of modern quantum technology. Here, we propose a general quantum-learning-control method for optimally controlling LGQ systems based on the gradient-descent algorithm. Our approach flexibly designs the loss function for diverse tasks by utilizing first- and second-order moments that completely describe the quantum state of LGQ systems. We demonstrate both deep optomechanical cooling and large optomechanical entanglement using this approach. Our approach enables the fast and deep ground-state cooling of a mechanical resonator within a short time, surpassing the limitations of sideband cooling in the continuous-wave driven strong-coupling regime. Furthermore, optomechanical entanglement could be generated remarkably fast and surpass several times the corresponding steady-state entanglement, even when the thermal phonon occupation reaches one hundred. This work will not only broaden the application of quantum learning control, but also open an avenue for optimal control of LGQ systems.

DOI
10.1103/physreva.109.063508

Related papers

Entanglement engineering of optomechanical systems by reinforcement learning

Lili Ye, Christian Arenz, Joseph M. Lukens +1 more

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

APL Machine Learning•Jan 17, 2025•7 citations

Entanglement engineering of optomechanical systems by reinforcement learning

Li-Li Ye, Christian Arenz, Joseph M. Lukens +1 more

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement -- so-called entanglement engineering -- for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon-phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

arXiv:2406.04550•Jun 6, 2024•1 citation

A gradient descent approach to optimal coherent quantum LQG controller design

Arash Kh. Sichani, Igor G. Vladimirov, Ian R. Petersen

This paper is concerned with the Coherent Quantum Linear Quadratic Gaussian (CQLQG) control problem of finding a stabilizing measurement-free quantum controller for a quantum plant so as to minimize an infinite-horizon mean square performance index for the fully quantum closed-loop system. In comparison with the observation-actuation structure of classical controllers, the coherent quantum feedback is less invasive to the quantum dynamics and quantum information. Both the plant and the controller are open quantum systems whose dynamic variables satisfy the canonical commutation relations (CCRs) of a quantum harmonic oscillator and are governed by linear quantum stochastic differential equations (QSDEs). In order to correspond to such oscillators, these QSDEs must satisfy physical realizability (PR) conditions, which are organised as quadratic constraints on the controller matrices and reflect the preservation of CCRs in time. The CQLQG problem is a constrained optimization problem for the steady-state quantum covariance matrix of the plant-controller system satisfying an algebraic Lyapunov equation. We propose a gradient descent algorithm equipped with adaptive stepsize selection for the numerical solution of the problem. The algorithm finds a local minimum of the LQG cost over the parameters of the Hamiltonian and coupling operators of a stabilizing PR quantum controller, thus taking the PR constraints into account. A convergence analysis of the proposed algorithm is presented.

arXiv:1502.00274•Proceedings of the ... American Control Conference/Proceedings of the American Control Conference•Jul 1, 2015•7 citations

Fast laser cooling using optimal quantum control

Xie-Qian Li, Shuo Zhang, Jie Zhang +3 more

Cooling down a trapped ion into its motional ground state is a central step for trapped-ion-based quantum information processing. State-of-the-art cooling schemes often work under a set of optimal cooling conditions derived analytically using a perturbative approach, in which the sideband coupling is assumed to be the weakest of all the relevant transitions. As a result, the cooling rate is severely limited. Here we propose to use a quantum control technique powered with automatic differentiation to speed up the classical cooling schemes. We demonstrate the efficacy of our approach by applying it to find the optimal cooling conditions for classical sideband cooling and electromagnetically induced transparency cooling schemes, which are in general beyond the weak-sideband-coupling regime. Based on those numerically found optimal cooling conditions, we show that faster cooling can be achieved while at the same time a low average phonon occupation can be retained.

arXiv:2106.05443•Physical Review A•Oct 5, 2021•4 citations

Optimal Lyapunov-based quantum control for quantum systems

S. C. Hou, Muhammad Aslam Khan, X. X. Yi +2 more

Quantum Lyapunov control was developed in order to transform a quantum system from arbitrary initial states to a target state. The idea is to find control fields that steer the Lyapunov function to zero as $t\ensuremath{\rightarrow}\ensuremath{\infty}$, meanwhile the quantum system is driven to the target state. In order to shorten the time required to reach the target state, we propose two designs to optimize Lyapunov control in this paper. The first design makes the Lyapunov function decrease as fast as possible with a constraint on the total power of control fields, and the second design has the same purpose but with a constraint on each control field. Examples of a three-level system demonstrate that the evolution time for Lyapunov control can be significantly shortened, especially when high control fidelity is required. Besides, this optimal Lyapunov-based quantum control is robust against uncertainties in the free Hamiltonian and decoherence in the system compared to conventional Lyapunov control. We apply our optimal design to cool a nanomechanical resonator where a shorter cooling time is found with respect to the cooling time by the conventional Lyapunov design.

arXiv:1203.5373•Physical Review A•Aug 21, 2012•118 citations

Gradient-based optimal control of open quantum systems using quantum trajectories and automatic differentiation

Mohamed R. Abdelhafez, David Schuster, Jens Koch

We present a gradient-based optimal-control technique for open quantum systems that utilizes quantum trajectories to simulate the quantum dynamics during optimization. Using trajectories allows for optimizing open systems with less computational cost than the regular density matrix approaches in most realistic optimization problems. We introduce an improved-sampling algorithm which minimizes the number of trajectories needed per optimization iteration. Together with employing stochastic gradient descent techniques, this reduces the complexity of optimizing many realistic open quantum systems to the complexity encountered with closed systems. Our optimizer harnesses automatic differentiation to provide flexibility in optimization and to suit the different constraints and diverse parameter regimes of real-life experiments. We utilize the optimizer in a variety of applications to demonstrate how the use of quantum trajectories significantly reduces the computation complexity while achieving a multitude of simultaneous optimization targets. Demonstrated targets include high state-transfer fidelities despite dissipation, faster gate times, and maximization of qubit-readout fidelity while maintaining the quantum nondemolition nature of the measurement and allowing for subsequent fast resonator reset.

arXiv:1901.05541•Physical Review A•May 20, 2019•86 citations
Efficiently controlling linear Gaussian quantum (LGQ) systems is a significant task in both the study of fundamental quantum theory and the development of modern quantum technology. Here, we propose a general quantum-learning-control method for optimally controlling LGQ systems based on the gradient-descent algorithm. Our approach flexibly designs the loss function for diverse tasks by utilizing first- and second-order moments that completely describe the quantum state of LGQ systems. We demonstrate both deep optomechanical cooling and large optomechanical entanglement using this approach. Our approach enables the fast and deep ground-state cooling of a mechanical resonator within a short time, surpassing the limitations of sideband cooling in the continuous-wave driven strong-coupling regime. Furthermore, optomechanical entanglement could be generated remarkably fast and surpass several times the corresponding steady-state entanglement, even when the thermal phonon occupation reaches one hundred. This work will not only broaden the application of quantum learning control, but also open an avenue for optimal control of LGQ systems.
Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.
Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement -- so-called entanglement engineering -- for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon-phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.
This paper is concerned with the Coherent Quantum Linear Quadratic Gaussian (CQLQG) control problem of finding a stabilizing measurement-free quantum controller for a quantum plant so as to minimize an infinite-horizon mean square performance index for the fully quantum closed-loop system. In comparison with the observation-actuation structure of classical controllers, the coherent quantum feedback is less invasive to the quantum dynamics and quantum information. Both the plant and the controller are open quantum systems whose dynamic variables satisfy the canonical commutation relations (CCRs) of a quantum harmonic oscillator and are governed by linear quantum stochastic differential equations (QSDEs). In order to correspond to such oscillators, these QSDEs must satisfy physical realizability (PR) conditions, which are organised as quadratic constraints on the controller matrices and reflect the preservation of CCRs in time. The CQLQG problem is a constrained optimization problem for the steady-state quantum covariance matrix of the plant-controller system satisfying an algebraic Lyapunov equation. We propose a gradient descent algorithm equipped with adaptive stepsize selection for the numerical solution of the problem. The algorithm finds a local minimum of the LQG cost over the parameters of the Hamiltonian and coupling operators of a stabilizing PR quantum controller, thus taking the PR constraints into account. A convergence analysis of the proposed algorithm is presented.
Cooling down a trapped ion into its motional ground state is a central step for trapped-ion-based quantum information processing. State-of-the-art cooling schemes often work under a set of optimal cooling conditions derived analytically using a perturbative approach, in which the sideband coupling is assumed to be the weakest of all the relevant transitions. As a result, the cooling rate is severely limited. Here we propose to use a quantum control technique powered with automatic differentiation to speed up the classical cooling schemes. We demonstrate the efficacy of our approach by applying it to find the optimal cooling conditions for classical sideband cooling and electromagnetically induced transparency cooling schemes, which are in general beyond the weak-sideband-coupling regime. Based on those numerically found optimal cooling conditions, we show that faster cooling can be achieved while at the same time a low average phonon occupation can be retained.
Quantum Lyapunov control was developed in order to transform a quantum system from arbitrary initial states to a target state. The idea is to find control fields that steer the Lyapunov function to zero as $t\ensuremath{\rightarrow}\ensuremath{\infty}$, meanwhile the quantum system is driven to the target state. In order to shorten the time required to reach the target state, we propose two designs to optimize Lyapunov control in this paper. The first design makes the Lyapunov function decrease as fast as possible with a constraint on the total power of control fields, and the second design has the same purpose but with a constraint on each control field. Examples of a three-level system demonstrate that the evolution time for Lyapunov control can be significantly shortened, especially when high control fidelity is required. Besides, this optimal Lyapunov-based quantum control is robust against uncertainties in the free Hamiltonian and decoherence in the system compared to conventional Lyapunov control. We apply our optimal design to cool a nanomechanical resonator where a shorter cooling time is found with respect to the cooling time by the conventional Lyapunov design.
We present a gradient-based optimal-control technique for open quantum systems that utilizes quantum trajectories to simulate the quantum dynamics during optimization. Using trajectories allows for optimizing open systems with less computational cost than the regular density matrix approaches in most realistic optimization problems. We introduce an improved-sampling algorithm which minimizes the number of trajectories needed per optimization iteration. Together with employing stochastic gradient descent techniques, this reduces the complexity of optimizing many realistic open quantum systems to the complexity encountered with closed systems. Our optimizer harnesses automatic differentiation to provide flexibility in optimization and to suit the different constraints and diverse parameter regimes of real-life experiments. We utilize the optimizer in a variety of applications to demonstrate how the use of quantum trajectories significantly reduces the computation complexity while achieving a multitude of simultaneous optimization targets. Demonstrated targets include high state-transfer fidelities despite dissipation, faster gate times, and maximization of qubit-readout fidelity while maintaining the quantum nondemolition nature of the measurement and allowing for subsequent fast resonator reset.