Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:quant-ph/0412091 · Journal of Optics B Quantum and Semiclassical Optics

A quantum Langevin formulation of risk-sensitive optimal control

M R James

Published Sep 14, 2005• 50 citations
arXivHTMLPDF

Abstract

In this paper we formulate a risk-sensitive optimal control problem for continuously monitored open quantum systems modelled by quantum Langevin equations. The optimal controller is expressed in terms of a modified conditional state, which we call a risk-sensitive state, that represents measurement knowledge tempered by the control purpose. One of the two components of the optimal controller is dynamic, a filter that computes the risk-sensitive state. The second component is an optimal control feedback function that is found by solving the dynamic programming equation. The optimal controller can be implemented using classical electronics. The ideas are illustrated using an example of feedback control of a two-level atom.

DOI
10.1088/1464-4266/7/10/002

Related papers

Risk-sensitive optimal control of quantum systems

M. R. James

The importance of feedback control is being increasingly appreciated in quantum physics and applications. This paper describes the use of optimal control methods in the design of quantum feedback control systems, and in particular the paper formulates and solves a risk-sensitive optimal control problem. The resulting risk-sensitive optimal control is given in terms of an unnormalized conditional state, whose dynamics include the cost function used to specify the performance objective. The risk-sensitive conditional dynamic equation describes the evolution of our knowledge of the quantum system tempered by our purpose for the controlled quantum system. Robustness properties of risk-sensitive controllers are discussed and an example is provided.

arXiv:quant-ph/0302136•Physical Review A•Mar 19, 2004•112 citations

Quantum Risk-Sensitive Control

Cassius D'Helon, Andrew C. Doherty, M. R. James +1 more

The purpose of this paper is to describe some recent results concerning optimal feedback control of quantum systems using risk-sensitive performance criteria. We employ quantum stochastic models to describe an important class of quantum systems and define a risk-sensitive criterion for these models. A suitable information state is introduced to solve the optimal control problem using dynamic programming. The results are illustrated by examples

IEEE Conference on Decision and Control (CDC)•Jan 1, 2006•25 citations

Open quantum systems with linear dynamics: optimal unravellings for optimal feedback control

Howard M. Wiseman, Andrew C. Doherty

Quantum feedback control is the control of the dynamics of a quantum system by feeding back (in real time) the results of monitoring that system. For systems with linear dynamics, the control problem is amenable to exact analysis. In these cases, the quantum system is equivalent to a stochastic system of classical phase-space variables with linear drift and constant diffusion, and with a measured current (e.g. a homodyne photocurrent) linear in the system variables. However, the classical evolution is constrained in order to represent valid quantum evolution. We quantify this in terms of a linear matrix inequality (LMI) relating the drift and diffusion (a sort of zero temperature fluctuation-dissipation theorem), and another LMI for the covariance matrix of the possible conditioned states (i.e. under all possible monitoring schemes consistent with the master equation). For manipulable systems (i.e. where the experimenter has arbitrary control over the parameters in a Hamiltonian linear in the system variables) the covariance of the conditioned state is all that is needed to calculate the effectiveness of the feedback. In this case the double optimization problem reduces to a semidefinite program, which can be solved efficiently in general. We illustrate this with an example drawn from quantum optics.

Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE•May 25, 2004•0 citations

Dynamical programming of continuously observed quantum systems

V. P. Belavkin, Antonio Negretti, Klaus Mølmer

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes, which correspond, respectively, to deterministic and stochastic master equation dynamics. For the quantum feedback control scheme with continuous nondemolition observations, we exploit the separation theorem of filtering and control aspects for quantum stochastic dynamics to derive a generalized Hamilton-Jacobi-Bellman equation. If the control is restricted to only Hamiltonian terms this is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term. In this work, we consider, in particular, the case when control is restricted only to observation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure state from a mixed state of a quantum two-level system.

arXiv:0805.4741•Physical Review A•Feb 27, 2009•24 citations

Optimal Quantum Control Theory

M. R. James

This article explains some fundamental ideas concerning the optimal control of quantum systems through the study of a relatively simple two-level system coupled to optical fields. The model for this system includes both continuous and impulsive dynamics. Topics covered include open- and closed-loop control, impulsive control, open-loop optimal control, quantum filtering, and measurement feedback optimal control.

Annual Review of Control Robotics and Autonomous Systems•Jan 12, 2021•24 citations

THEORY OF THE CONTROL OF OBSERVABLE QUANTUM SYSTEMS

V. P. Belavkin

Abstract. The fundamental mathematical definitions of the controlled feedback Markov dynamics of quantum-mechanical systems are introduced with regard to the dynamical reduction and filtering of quantum states in the course of quantum measurement in either discrete or continuous real time. The concept of sufficient coordinates for the description of a posteriori quantum states in a given class is introduced and it is proved that they form a classical Markov process with values in either state operators or state vector space. The general problem of optimal control of a quantum-mechanical system is discussed and the corresponding Bellman equation in the space of sufficient coordinates is derived. The results are illustrated in the example of control of the semigroup dynamics of a quantum system that is instantaneously observed at discrete times and evolves between measurement times according to the Schrődinger equation. 1.

•Jan 1, 2005•56 citations
In this paper we formulate a risk-sensitive optimal control problem for continuously monitored open quantum systems modelled by quantum Langevin equations. The optimal controller is expressed in terms of a modified conditional state, which we call a risk-sensitive state, that represents measurement knowledge tempered by the control purpose. One of the two components of the optimal controller is dynamic, a filter that computes the risk-sensitive state. The second component is an optimal control feedback function that is found by solving the dynamic programming equation. The optimal controller can be implemented using classical electronics. The ideas are illustrated using an example of feedback control of a two-level atom.
The importance of feedback control is being increasingly appreciated in quantum physics and applications. This paper describes the use of optimal control methods in the design of quantum feedback control systems, and in particular the paper formulates and solves a risk-sensitive optimal control problem. The resulting risk-sensitive optimal control is given in terms of an unnormalized conditional state, whose dynamics include the cost function used to specify the performance objective. The risk-sensitive conditional dynamic equation describes the evolution of our knowledge of the quantum system tempered by our purpose for the controlled quantum system. Robustness properties of risk-sensitive controllers are discussed and an example is provided.
Quantum feedback control is the control of the dynamics of a quantum system by feeding back (in real time) the results of monitoring that system. For systems with linear dynamics, the control problem is amenable to exact analysis. In these cases, the quantum system is equivalent to a stochastic system of classical phase-space variables with linear drift and constant diffusion, and with a measured current (e.g. a homodyne photocurrent) linear in the system variables. However, the classical evolution is constrained in order to represent valid quantum evolution. We quantify this in terms of a linear matrix inequality (LMI) relating the drift and diffusion (a sort of zero temperature fluctuation-dissipation theorem), and another LMI for the covariance matrix of the possible conditioned states (i.e. under all possible monitoring schemes consistent with the master equation). For manipulable systems (i.e. where the experimenter has arbitrary control over the parameters in a Hamiltonian linear in the system variables) the covariance of the conditioned state is all that is needed to calculate the effectiveness of the feedback. In this case the double optimization problem reduces to a semidefinite program, which can be solved efficiently in general. We illustrate this with an example drawn from quantum optics.
We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes, which correspond, respectively, to deterministic and stochastic master equation dynamics. For the quantum feedback control scheme with continuous nondemolition observations, we exploit the separation theorem of filtering and control aspects for quantum stochastic dynamics to derive a generalized Hamilton-Jacobi-Bellman equation. If the control is restricted to only Hamiltonian terms this is equivalent to a Hamilton-Jacobi equation with an extra linear dissipative term. In this work, we consider, in particular, the case when control is restricted only to observation. A controlled qubit is considered as an example throughout the development of the formalism. Finally, we discuss optimum observation strategies to obtain a pure state from a mixed state of a quantum two-level system.
Abstract. The fundamental mathematical definitions of the controlled feedback Markov dynamics of quantum-mechanical systems are introduced with regard to the dynamical reduction and filtering of quantum states in the course of quantum measurement in either discrete or continuous real time. The concept of sufficient coordinates for the description of a posteriori quantum states in a given class is introduced and it is proved that they form a classical Markov process with values in either state operators or state vector space. The general problem of optimal control of a quantum-mechanical system is discussed and the corresponding Bellman equation in the space of sufficient coordinates is derived. The results are illustrated in the example of control of the semigroup dynamics of a quantum system that is instantaneously observed at discrete times and evolves between measurement times according to the Schrődinger equation. 1.