High-fidelity state preparation represents a fundamental challenge in the application of quantum technology. While the majority of optimal control approaches use feedback to improve the controller, the controller itself often does not incorporate explicit state dependence. Here, we present a general framework for training deep feedback networks for open quantum systems with continuous weak measurement that allows a variety of system and control structures that are prohibitive by many other techniques and can in effect react to unmodeled effects through nonlinear filtering. Our approach benefits from characteristics of both stochastic sampling and gradient-based optimization methods yet does not require differentiability as in backpropagation approaches. We demonstrate that this method is efficient due to inherent parallelizability, robust to open system interactions, and outperforms landmark state-dependent feedback control results in simulation.
High-fidelity state preparation represents a fundamental challenge in the application of quantum technology. While the majority of optimal control approaches use feedback to improve the controller, the controller itself often does not incorporate explicit state dependence. Here, we present a general framework for training deep feedback networks for open quantum systems with continuous weak measurement that allows a variety of system and control structures that are prohibitive by many other techniques and can in effect react to unmodeled effects through nonlinear filtering. Our approach benefits from characteristics of both stochastic sampling and gradient-based optimization methods yet does not require differentiability as in backpropagation approaches. We demonstrate that this method is efficient due to inherent parallelizability, robust to open system interactions, and outperforms landmark state-dependent feedback control results in simulation.
High fidelity state preparation represents a fundamental challenge in the application of quantum technology. While the majority of optimal control approaches use feedback to improve the controller, the controller itself often does not incorporate explicit state dependence. Here, we present a general framework for training deep feedback networks for open quantum systems with quantum nondemolition measurement that allows a variety of system and control structures that are prohibitive by many other techniques and can in effect react to unmodeled effects through nonlinear filtering. We demonstrate that this method is efficient due to inherent parallelizability, robust to open system interactions, and outperforms landmark state feedback control results in simulation.
This review develops a control-theoretic perspective on measurement-based feedback for continuously monitored open quantum systems, with the main analysis focused on finite-dimensional systems governed by diffusive stochastic master equations. We introduce the relevant state-space, invariant-subspace, and quantum non-demolition structures, interpret quantum filtering as nonlinear observer dynamics, and review open-loop asymptotics, filter stability, state-feedback stabilization, robustness, and reduced-order observer-based control. Particular emphasis is placed on a recurrence--contraction framework, in which Hamiltonian feedback removes non-target invariant obstructions while measurement-induced dynamics provide local exponential contraction. Although the detailed analysis is developed for finite-dimensional diffusive models, the underlying measurement--estimation--feedback architecture is relevant across a broad range of quantum platforms. We further discuss implementation challenges and open problems involving scalable estimation, sampling and delay, adaptation, hybrid and non-Markovian dynamics, practical stability, optimal control, and learning-based design. By organizing these developments around invariance, estimation, recurrence, and contraction, the review provides a tutorial bridge between measurement-based quantum feedback and nonlinear stochastic control.
In practical applications, quantum systems are inevitably subject to significant uncertainties, including unknown initial states, imprecise physical parameters, and unmodeled environmental noise, all of which pose major challenges to robust quantum feedback control. This paper proposes a feedback stabilization strategy based on a reduced quantum filter that achieves robustness against time-varying Hamiltonian perturbations and additional dissipative effects, without requiring prior knowledge of the initial state or exact system parameters. The proposed filter estimates only O(N) real variables corresponding to the diagonal elements of the system density matrix in a quantum non-demolition basis in contrast to the O(N^2) variables required by a full stochastic master equation, where N is the Hilbert space dimension. This dimensionality reduction substantially simplifies real-time computation and feedback implementation while preserving both convergence and robustness guarantees. Rigorous analysis further establishes global exponential stability of the target subspace. The results provide a scalable framework for robust and efficient measurement-based feedback control applicable to high-dimensional perturbed open quantum systems.
Abstract Emerging reinforcement learning techniques using deep neural networks have shown great promise in control optimization. They harness non-local regularities of noisy control trajectories and facilitate transfer learning between tasks. To leverage these powerful capabilities for quantum control optimization, we propose a new control framework to simultaneously optimize the speed and fidelity of quantum computation against both leakage and stochastic control errors. For a broad family of two-qubit unitary gates that are important for quantum simulation of many-electron systems, we improve the control robustness by adding control noise into training environments for reinforcement learning agents trained with trusted-region-policy-optimization. The agent control solutions demonstrate a two-order-of-magnitude reduction in average-gate-error over baseline stochastic-gradient-descent solutions and up to a one-order-of-magnitude reduction in gate time from optimal gate synthesis counterparts. These significant improvements in both fidelity and runtime are achieved by combining new physical understandings and state-of-the-art machine learning techniques. Our results open a venue for wider applications in quantum simulation, quantum chemistry and quantum supremacy tests using near-term quantum devices.
Closed loop quantum control uses measurement to control the dynamics of a quantum system to achieve either a desired target state or target dynamics. In the case when the quantum Hamiltonian is quadratic in x and p, there are known optimal control techniques to drive the dynamics toward particular states, e.g., the ground state. However, for nonlinear Hamiltonian such control techniques often fail. We apply deep reinforcement learning (DRL), where an artificial neural agent explores and learns to control the quantum evolution of a highly nonlinear system (double well), driving the system toward the ground state with high fidelity. We consider a DRL strategy which is particularly motivated by experiment where the quantum system is continuously but weakly measured. This measurement is then fed back to the neural agent and used for training. We show that the DRL can effectively learn counterintuitive strategies to cool the system to a nearly pure "cat" state, which has a high overlap fidelity with the true ground state.
Obtaining reliable state preparation protocols is a key step toward practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to derive a feedback law for state preparation of a desired state in a target system. In particular, we focus on the robustness of the obtained strategies with respect to different types and amount of noise. Comparing the results indicates that the learned controls are more robust to unmodeled perturbations with respect to simple feedback strategy based on optimized population transfer, and that training on a simulated nominal model retains the same advantages displayed by controllers trained on real data. The possibility of effective off-line training of robust controllers promises significant advantages toward practical implementation.