High fidelity state preparation represents a fundamental challenge in the application of quantum technology. While the majority of optimal control approaches use feedback to improve the controller, the controller itself often does not incorporate explicit state dependence. Here, we present a general framework for training deep feedback networks for open quantum systems with quantum nondemolition measurement that allows a variety of system and control structures that are prohibitive by many other techniques and can in effect react to unmodeled effects through nonlinear filtering. We demonstrate that this method is efficient due to inherent parallelizability, robust to open system interactions, and outperforms landmark state feedback control results in simulation.
High fidelity state preparation represents a fundamental challenge in the application of quantum technology. While the majority of optimal control approaches use feedback to improve the controller, the controller itself often does not incorporate explicit state dependence. Here, we present a general framework for training deep feedback networks for open quantum systems with quantum nondemolition measurement that allows a variety of system and control structures that are prohibitive by many other techniques and can in effect react to unmodeled effects through nonlinear filtering. We demonstrate that this method is efficient due to inherent parallelizability, robust to open system interactions, and outperforms landmark state feedback control results in simulation.
High-fidelity state preparation represents a fundamental challenge in the application of quantum technology. While the majority of optimal control approaches use feedback to improve the controller, the controller itself often does not incorporate explicit state dependence. Here, we present a general framework for training deep feedback networks for open quantum systems with continuous weak measurement that allows a variety of system and control structures that are prohibitive by many other techniques and can in effect react to unmodeled effects through nonlinear filtering. Our approach benefits from characteristics of both stochastic sampling and gradient-based optimization methods yet does not require differentiability as in backpropagation approaches. We demonstrate that this method is efficient due to inherent parallelizability, robust to open system interactions, and outperforms landmark state-dependent feedback control results in simulation.
Abstract Emerging reinforcement learning techniques using deep neural networks have shown great promise in control optimization. They harness non-local regularities of noisy control trajectories and facilitate transfer learning between tasks. To leverage these powerful capabilities for quantum control optimization, we propose a new control framework to simultaneously optimize the speed and fidelity of quantum computation against both leakage and stochastic control errors. For a broad family of two-qubit unitary gates that are important for quantum simulation of many-electron systems, we improve the control robustness by adding control noise into training environments for reinforcement learning agents trained with trusted-region-policy-optimization. The agent control solutions demonstrate a two-order-of-magnitude reduction in average-gate-error over baseline stochastic-gradient-descent solutions and up to a one-order-of-magnitude reduction in gate time from optimal gate synthesis counterparts. These significant improvements in both fidelity and runtime are achieved by combining new physical understandings and state-of-the-art machine learning techniques. Our results open a venue for wider applications in quantum simulation, quantum chemistry and quantum supremacy tests using near-term quantum devices.
In practical applications, quantum systems are inevitably subject to significant uncertainties, including unknown initial states, imprecise physical parameters, and unmodeled environmental noise, all of which pose major challenges to robust quantum feedback control. This paper proposes a feedback stabilization strategy based on a reduced quantum filter that achieves robustness against time-varying Hamiltonian perturbations and additional dissipative effects, without requiring prior knowledge of the initial state or exact system parameters. The proposed filter estimates only O(N) real variables corresponding to the diagonal elements of the system density matrix in a quantum non-demolition basis in contrast to the O(N^2) variables required by a full stochastic master equation, where N is the Hilbert space dimension. This dimensionality reduction substantially simplifies real-time computation and feedback implementation while preserving both convergence and robustness guarantees. Rigorous analysis further establishes global exponential stability of the target subspace. The results provide a scalable framework for robust and efficient measurement-based feedback control applicable to high-dimensional perturbed open quantum systems.
Obtaining reliable state preparation protocols is a key step toward practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to derive a feedback law for state preparation of a desired state in a target system. In particular, we focus on the robustness of the obtained strategies with respect to different types and amount of noise. Comparing the results indicates that the learned controls are more robust to unmodeled perturbations with respect to simple feedback strategy based on optimized population transfer, and that training on a simulated nominal model retains the same advantages displayed by controllers trained on real data. The possibility of effective off-line training of robust controllers promises significant advantages toward practical implementation.
This review develops a control-theoretic perspective on measurement-based feedback for continuously monitored open quantum systems, with the main analysis focused on finite-dimensional systems governed by diffusive stochastic master equations. We introduce the relevant state-space, invariant-subspace, and quantum non-demolition structures, interpret quantum filtering as nonlinear observer dynamics, and review open-loop asymptotics, filter stability, state-feedback stabilization, robustness, and reduced-order observer-based control. Particular emphasis is placed on a recurrence--contraction framework, in which Hamiltonian feedback removes non-target invariant obstructions while measurement-induced dynamics provide local exponential contraction. Although the detailed analysis is developed for finite-dimensional diffusive models, the underlying measurement--estimation--feedback architecture is relevant across a broad range of quantum platforms. We further discuss implementation challenges and open problems involving scalable estimation, sampling and delay, adaptation, hybrid and non-Markovian dynamics, practical stability, optimal control, and learning-based design. By organizing these developments around invariance, estimation, recurrence, and contraction, the review provides a tutorial bridge between measurement-based quantum feedback and nonlinear stochastic control.
This paper presents a novel approach to dynamic quantum control utilizing feedback learning algorithms. The core idea is to develop a system capable of real-time adjustment of control parameters based on feedback information obtained from the quantum system itself. This approach addresses the inherent challenges in precisely controlling quantum systems, which are often highly sensitive to environmental noise and difficult to model accurately. The proposed framework leverages the principles of quantum control and feedback learning to achieve optimal control performance. The system architecture incorporates a closed-loop control mechanism where the system's output is continuously monitored, and the control parameters are adjusted accordingly. Mathematical formulations detailing the control process, feedback mechanisms, and optimization strategies are provided. This work contributes to advancements in quantum control by offering a robust and adaptable method for manipulating quantum states, with potential applications in quantum computing, quantum sensing, and quantum communication. The algorithm is designed to minimize the influence of external disturbances and maximize the accuracy of state preparation and manipulation. The presented approach provides a pathway towards more reliable and efficient quantum control strategies.