Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:quant-ph/0407192 · Journal of Physics B Atomic Molecular and Optical Physics

Bellman equations for optimal feedback control of qubit states

Luc Bouten, Simon Edwards, V. P. Belavkin

Published Jan 25, 2005• 63 citations
arXivHTMLPDF

Abstract

Using results from quantum filtering theory and methods from classical control theory, we derive an optimal control strategy for an open two-level system (a qubit in interaction with the electromagnetic field) controlled by a laser. The aim is to optimally choose the laser's amplitude and phase in order to drive the system into a desired state. The Bellman equations are obtained for the case of diffusive and counting measurements for vacuum field states. A full exact solution of the optimal control problem is given for a system with simpler, linear, dynamics. These linear dynamics can be obtained physically by considering a two-level atom in a strongly driven, heavily damped, optical cavity.

DOI
10.1088/0953-4075/38/3/002

Related papers

Optimal Quantum Filtering and Quantum Feedback Control

Simon Edwards, V. P. Belavkin

Quantum mechanical systems exhibit an inherently probabilistic nature upon measurement. Using a quantum noise model to describe the stochastic evolution of the open quantum system and working in parallel with classical indeterministic control theory, we present the theory of nonlinear optimal quantum feedback control. The resulting quantum Bellman equation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian (LQG) problem which emphasizes many similarities with the corresponding classical control problem.

arXiv:quant-ph/0506018•Jun 2, 2005•56 citations

Hamilton–Jacobi–Bellman equations for quantum optimal feedback control

John Edward Gough, V. P. Belavkin, Oleg Georgievich Smolyanov

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilton-Pontryagin setup. We show that, for cost functionals that are linear in the state, the theory yields the traditional Bellman equations treated so far in quantum feedback.

arXiv:quant-ph/0502155•Journal of Optics B Quantum and Semiclassical Optics•Sep 14, 2005•62 citations

Towards the theory of control in observable quantum systems

V. P. Belavkin

An operational description of the controlled Markov dynamics of quantum-mechanical system is introduced. The feedback control strategies with regard to the dynamical reduction of quantum states in the course of quantum real-time measurements are discribed in terms of quantum filtering of these states. The concept of sufficient coordinates for the description of the a posteriori quantum states from a given class is introduced, and it is proved that they form a classical Markov process with values in either state operators or state vector space. The general problem of optimal control of a quantum-mechanical system is discussed and the corresponding Bellman equation in the space of sufficient coordinates is derived. The results are illustrated in the example of control of the semigroup dynamics of a quantum system that is instantaneously observed at discrete times and evolves between measurement times according to the Schroedinger equation.

arXiv:quant-ph/0408003•Aug 1, 2004•23 citations

Quantum demolition filtering and optimal control of unstable systems

V. P. Belavkin

A brief account of the quantum information dynamics and dynamical programming methods for optimal control of quantum unstable systems is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme, we exploit the separation theorem of filtering and control aspects as in the usual case of quantum stable systems with non-demolition observation. This allows us to start with the Belavkin quantum filtering equation generalized to demolition observations and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to Hamiltonian terms in the filtering equation. An unstable controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.

Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences•Oct 22, 2012•2 citations

Open quantum systems with linear dynamics: optimal unravellings for optimal feedback control

Howard M. Wiseman, Andrew C. Doherty

Quantum feedback control is the control of the dynamics of a quantum system by feeding back (in real time) the results of monitoring that system. For systems with linear dynamics, the control problem is amenable to exact analysis. In these cases, the quantum system is equivalent to a stochastic system of classical phase-space variables with linear drift and constant diffusion, and with a measured current (e.g. a homodyne photocurrent) linear in the system variables. However, the classical evolution is constrained in order to represent valid quantum evolution. We quantify this in terms of a linear matrix inequality (LMI) relating the drift and diffusion (a sort of zero temperature fluctuation-dissipation theorem), and another LMI for the covariance matrix of the possible conditioned states (i.e. under all possible monitoring schemes consistent with the master equation). For manipulable systems (i.e. where the experimenter has arbitrary control over the parameters in a Hamiltonian linear in the system variables) the covariance of the conditioned state is all that is needed to calculate the effectiveness of the feedback. In this case the double optimization problem reduces to a semidefinite program, which can be solved efficiently in general. We illustrate this with an example drawn from quantum optics.

Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE•May 25, 2004•0 citations

On the duality of quantum filtering and optimal feedback control in quantum open linear dynamical systems

Simon Edwards, V. P. Belavkin

The multi-dimensional quality open linear dynamical system with observation and feedback along a quantum linear transmission line is studied in discrete time. The linear least squares filtering and optimal control strategies are obtained as quantum analogies of the Kalman filter and Bellman dynamical programming. The duality of quantum filtering and optimal feedback control is observed for this particular case.

IEEE International Workshop on Workload Characterization (WWC)•Apr 23, 2004•4 citations
Using results from quantum filtering theory and methods from classical control theory, we derive an optimal control strategy for an open two-level system (a qubit in interaction with the electromagnetic field) controlled by a laser. The aim is to optimally choose the laser's amplitude and phase in order to drive the system into a desired state. The Bellman equations are obtained for the case of diffusive and counting measurements for vacuum field states. A full exact solution of the optimal control problem is given for a system with simpler, linear, dynamics. These linear dynamics can be obtained physically by considering a two-level atom in a strongly driven, heavily damped, optical cavity.
Quantum mechanical systems exhibit an inherently probabilistic nature upon measurement. Using a quantum noise model to describe the stochastic evolution of the open quantum system and working in parallel with classical indeterministic control theory, we present the theory of nonlinear optimal quantum feedback control. The resulting quantum Bellman equation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian (LQG) problem which emphasizes many similarities with the corresponding classical control problem.
We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilton-Pontryagin setup. We show that, for cost functionals that are linear in the state, the theory yields the traditional Bellman equations treated so far in quantum feedback.
An operational description of the controlled Markov dynamics of quantum-mechanical system is introduced. The feedback control strategies with regard to the dynamical reduction of quantum states in the course of quantum real-time measurements are discribed in terms of quantum filtering of these states. The concept of sufficient coordinates for the description of the a posteriori quantum states from a given class is introduced, and it is proved that they form a classical Markov process with values in either state operators or state vector space. The general problem of optimal control of a quantum-mechanical system is discussed and the corresponding Bellman equation in the space of sufficient coordinates is derived. The results are illustrated in the example of control of the semigroup dynamics of a quantum system that is instantaneously observed at discrete times and evolves between measurement times according to the Schroedinger equation.
A brief account of the quantum information dynamics and dynamical programming methods for optimal control of quantum unstable systems is given to both open loop and feedback control schemes corresponding respectively to deterministic and stochastic semi-Markov dynamics of stable or unstable systems. For the quantum feedback control scheme, we exploit the separation theorem of filtering and control aspects as in the usual case of quantum stable systems with non-demolition observation. This allows us to start with the Belavkin quantum filtering equation generalized to demolition observations and derive the generalized Hamilton-Jacobi-Bellman equation using standard arguments of classical control theory. This is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term if the control is restricted to Hamiltonian terms in the filtering equation. An unstable controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure quantum qubit state from a mixed one.
Quantum feedback control is the control of the dynamics of a quantum system by feeding back (in real time) the results of monitoring that system. For systems with linear dynamics, the control problem is amenable to exact analysis. In these cases, the quantum system is equivalent to a stochastic system of classical phase-space variables with linear drift and constant diffusion, and with a measured current (e.g. a homodyne photocurrent) linear in the system variables. However, the classical evolution is constrained in order to represent valid quantum evolution. We quantify this in terms of a linear matrix inequality (LMI) relating the drift and diffusion (a sort of zero temperature fluctuation-dissipation theorem), and another LMI for the covariance matrix of the possible conditioned states (i.e. under all possible monitoring schemes consistent with the master equation). For manipulable systems (i.e. where the experimenter has arbitrary control over the parameters in a Hamiltonian linear in the system variables) the covariance of the conditioned state is all that is needed to calculate the effectiveness of the feedback. In this case the double optimization problem reduces to a semidefinite program, which can be solved efficiently in general. We illustrate this with an example drawn from quantum optics.