The engineering and control of devices at the quantum mechanical level—such as those consisting of small numbers of atoms and photons—is a delicate business. The fundamental uncertainty that is inherently present at this scale manifests itself in the unavoidable presence of noise, making this a novel field of application for stochastic estimation and control theory. In this expository paper we demonstrate estimation and feedback control of quantum mechanical systems in what is essentially a noncommutative version of the binomial model that is popular in mathematical finance. The model is extremely rich and allows a full development of the theory while remaining completely within the setting of finite-dimensional Hilbert spaces (thus avoiding the technical complications of the continuous theory). We introduce discretized models of an atom in interaction with the electromagnetic field, obtain filtering equations for photon counting and homodyne detection, and solve a stochastic control problem using dynamic programming and Lyapunov function methods.
The engineering and control of devices at the quantum mechanical level—such as those consisting of small numbers of atoms and photons—is a delicate business. The fundamental uncertainty that is inherently present at this scale manifests itself in the unavoidable presence of noise, making this a novel field of application for stochastic estimation and control theory. In this expository paper we demonstrate estimation and feedback control of quantum mechanical systems in what is essentially a noncommutative version of the binomial model that is popular in mathematical finance. The model is extremely rich and allows a full development of the theory while remaining completely within the setting of finite-dimensional Hilbert spaces (thus avoiding the technical complications of the continuous theory). We introduce discretized models of an atom in interaction with the electromagnetic field, obtain filtering equations for photon counting and homodyne detection, and solve a stochastic control problem using dynamic programming and Lyapunov function methods.
Abstract. The engineering and control of devices at the quantum-mechanical level—such as those consisting of small numbers of atoms and photons—is a delicate business. The fundamental uncertainty that is inherently present at this scale manifests itself in the unavoidable presence of noise, making this a novel field of application for stochastic estimation and control theory. In this expository paper we demonstrate estimation and feedback control of quantum mechanical systems in what is essentially a noncommutative version of the binomial model that is popular in mathematical finance. The model is extremely rich and allows a full development of the theory, while remaining completely within the setting of finite-dimensional Hilbert spaces (thus avoiding the technical complications of the continuous theory). We introduce discretized models of an atom in interaction with the electromagnetic field, obtain filtering equations for photon counting and homodyne detection, and solve a stochastic control problem using dynamic programming and Lyapunov function methods.
This thesis explores the topics of parameter estimation and model reduction in the context of quantum filtering. The last is a mathematically rigorous formulation of continuous quantum measurement, in which a stream of auxiliary quantum systems is used to infer the state of a target quantum system. Fundamental quantum uncertainties appear as noise which corrupts the probe observations and therefore must be filtered in order to extract information about the target system. This is analogous to the classical filtering problem in which techniques of inference are used to process noisy observations of a system in order to estimate its state. Given the clear similarities between the two filtering problems, I devote the beginning of this thesis to a review of classical and quantum probability theory, stochastic calculus and filtering. This allows for a mathematically rigorous and technically adroit presentation of the quantum filtering problem and solution. Given this foundation, I next consider the related problem of quantum parameter estimation, in which one seeks to infer the strength of a parameter that drives the evolution of a probe quantum system. By embedding this problem in the state estimation problem solved by the quantum filter, I present the optimal Bayesian estimator for a parameter when given continuous measurements of the probe system to which it couples. For cases when the probe takes on a finite number of values, I review a set of sufficient conditions for asymptotic convergence of the estimator. For a continuous-valued parameter, I present a computational method called quantum particle filtering for practical estimation of the parameter. Using these methods, I then study the particular problem of atomic magnetometry and review an experimental method for potentially reducing the uncertainty in the estimate of the magnetic field beyond the standard quantum limit. The technique involves double-passing a probe laser field through the atomic system, giving rise to effective non-linearities which enhance the effect of Larmor precession allowing for improved magnetic field estimation. I then turn to the topic of model reduction, which is the search for a reduced computational model of a dynamical system. This is a particularly important task for quantum mechanical systems, whose state grows exponentially in the number of subsystems. In the quantum filtering setting, I study the use of model reduction in developing a feedback controller for continuous-time quantum error correction. By studying the propagation of errors in a noisy quantum memory, I present a computation model which scales polynomially, rather than exponentially, in the number of physical qubits of the system. Although inexact, a feedback controller using this model performs almost indistinguishably from one using the full model. I finally review an exact but polynomial model of collective qubit systems undergoing arbitrary symmetric dynamics which allows for the efficient simulation of spontaneous-emission and related open quantum system phenomenon.
Based on the stochastic differential equation of quantum mechanical feedback obtained in the first part of this paper, detailed control concepts and applications are discussed for quantum systems interacting with a noncommutative noise source. A feedback system in our framework is purely nonclassical in the sense that feedback control is performed via local operation and quantum communication through a quantum channel. The role of the controller is to alter the quantum dynamic characteristics of the plant through entanglement, shared between the plant and controller by sending quantum states, that is modulated by the Hamiltonian on the controller. The input-output relation of quantum systems provides a natural extension of control theory to the quantum domain. This enables one to present a control theoretical interpretation of some fundamental quantum mechanical notions such as the uncertainty principle, but also to find applications of ideas and tools of control theory. One of the most important applications is the production of squeezed states, which has been an important issue of quantum theory in relation to quantum computation and quantum communication. The method proposed here reduces the application to a conventional noise reduction problem with feedback. The H/sub /spl infin// control then leads to complete squeezing.
The concept of a controlled flow of a dynamical system, especially when the controlling process feeds information back about the system, is of central importance in control engineering. In this paper, we build on the ideas presented by Bouten and van Handel [Quantum Stochastics and Information: Statistics, Filtering and Control (World Scientific, 2008)] and develop a general theory of quantum feedback. We elucidate the relationship between the controlling processes, Z, and the measured processes, Y, and to this end we make a distinction between what we call the input picture and the output picture. We should note that the input-output relations for the noise fields have additional terms not present in the standard theory but that the relationship between the control processes and measured processes themselves is internally consistent—we do this for the two main cases of quadrature measurement and photon-counting measurement. The theory is general enough to include a modulating filter which post-processes the measurement readout Y before returning to the system. This opens up the prospect of applying very general engineering feedback control techniques to open quantum systems in a systematic manner, and we consider a number of specific modulating filter problems. Finally, we give a brief argument as to why most of the rules for making instantaneous feedback connections [J. Gough and M. R. James, Commun. Math. Phys. 287, 1109 (2009)] ought to apply for controlled dynamical networks as well.
Quantum mechanical systems exhibit an inherently probabilistic nature upon measurement which excludes in principle the singular direct observability continual case. Quantum theory of time continuous measurements and quantum prediction theory, developed by the author on the basis of an independent-increment model for quantum noise and nondemolition causality principle in the 80's, solves this problem allowing continual quantum predictions and reducing many quantum information problems like problems of quantum feedback control to the classical stochastic ones. Using explicit indirect observation models for diffusive and counting measurements we derive quantum filtering (prediction) equations to describe the stochastic evolution of the open quantum system under the continuous partial observation. Working in parallel with classical indeterministic control theory, we show the Markov Bellman equations for optimal feedback control of the a posteriori stochastic quantum states conditioned upon these two kinds of measurements. The resulting filtering and Bellman equation for the diffusive observation is then applied to the explicitly solvable quantum linear-quadratic-Gaussian (LQG) problem which emphasizes many similarities and differences with the corresponding classical nonlinear filtering and control problems and demonstrates microduality between quantum filtering and classical control.
The theory of quantum filtering (of quantum continuous measurements) was developed by V.P. Belavkin about 40 years ago. Since then it attracted attention of numerous investigators including mathematicians, theoretical and experimental physicists. However, the rigorous mathematical theory of the filtering equations for mixed states in basic infinite-dimensional quantum systems remained an open problem, which was resolved by the author recently. This survey paper presents in full the mathematical theory of quantum filtering equations, their rigorous derivation from basic principles, the corresponding law of large number limits (propagation of chaos) and related topics. Applications to feedback control, quantum dynamic and mean-field games are discussed.