arXiv:1204.6379

Discrete Quantum Control - State Preparation

Jon R. Grice, DAVID A. MEYER

Published Apr 28, 2012• 0 citations

Abstract

A discrete-time method for solving problems in optimal quantum control is presented. Controlling the time discretized markovian dynamics of a quantum system can be reduced to a Markov-decision process. We demonstrate this method in this with a class of simple one qubit systems, which are also discretized in space. For the task of state preparation we solve the examples both numerically and analytically with dynamic programming techniques.

DOI: 10.48550/arxiv.1204.6379

Related papers

Discrete quantum control

Jon R. Grice

This dissertation is a study of several aspects of discrete time quantum control. After reviewing the necessary background from quantum mechanics and control theory we construct a simple model and solve a control problem on it as a proof of concept for the discrete control formulation developed herein. We apply optimal control to solve a state preparation problem on a physically motivated time discretized single qubit system with simplified dynamics to enable the Bellman equation to be solved both numerically and approximately analytically. However for more than one qubit classical theories of control become problematic, a notable difficulty being the exponential increase in the size of the state space with the number of particles. To study workarounds for this problem we quantify how much information a quantum measurement can extract from the system and then use the results to show that a naive classical technique for controlling a multiparticle system performs poorly when the system has "quantum" properties. We then consider the problem of protecting the entanglement of a bipartite quantum system using discrete open loop control with a technique that seems to have no classical analog. The states of the bipartite system, called X-states, have a special structure which is generalized to states of systems with more than two qubits. We develop the properties of these generalized X-states which are a class of mixed states with interesting multipartite entanglement properties

Jan 1, 20090 citations

Discrete quantum control - eScholarship

Jon R. Grice

This dissertation is a study of several aspects of discrete time quantum control. After reviewing the necessary background from quantum mechanics and control theory we construct a simple model and solve a control problem on it as a proof of concept for the discrete control formulation developed herein. We apply optimal control to solve a state preparation problem on a physically motivated time discretized single qubit system with simplified dynamics to enable the Bellman equation to be solved both numerically and approximately analytically. However for more than one qubit classical theories of control become problematic, a notable difficulty being the exponential increase in the size of the state space with the number of particles. To study workarounds for this problem we quantify how much information a quantum measurement can extract from the system and then use the results to show that a naive classical technique for controlling a multiparticle system performs poorly when the system has quantum properties. We then consider the problem of protecting the entanglement of a bipartite quantum system using discrete open loop control with a technique that seems to have no classical analog. The states of the bipartite system, called X-states, have a special structure which is generalized to states of systems with more than two qubits. We develop the properties of these generalized X-states which are a class of mixed states with interesting multipartite entanglement properties

Jan 1, 20090 citations

Quantum Markov Decision Processes: General Theory, Approximations, and Classes of Policies

Naci Saldı, Sina Sanjari, Serdar Yüksel

Abstract. In this paper, the aim is to develop a quantum counterpart to classical Markov decision processes (MDPs). First, we provide a very general formulation of quantum MDPs with state and action spaces in the quantum domain, quantum transitions, and cost functions. Once we formulate the quantum MDP (q-MDP), our focus shifts to establishing the verification theorem that proves the sufficiency of Markovian quantum control policies and provides a dynamic programming principle. Subsequently, a comparison is drawn between our q-MDP model and previously established quantum MDP models (referred to as QOMDPs) found in the literature. Furthermore, approximations of q-MDPs are obtained via finite-action models, which can be formulated as QOMDPs. Finally, classes of open-loop and classical-state-preserving closed-loop policies for q-MDPs are introduced, along with structural results for these policies. In summary, we present a novel quantum MDP model aiming to introduce a new framework, algorithms, and future research avenues. We hope that our approach will pave the way for a new research direction in discrete-time quantum control.

arXiv:2402.14649SIAM Journal on Control and OptimizationApr 11, 20252 citations

Quantum Markov Decision Processes

Naci Saldı, Sina Sanjari, Serdar Yüksel

In this paper, we aim to develop a quantum counterpart to classical Markov decision processes (MDPs), referred to as q-MDPs. We first present a comprehensive formulation of quantum MDPs with state and action spaces in the quantum domain, quantum transitions, and cost functions. The focus then shifts to establishing a verification theorem for Markovian quantum control policies. Subsequently, we introduce classes of open-loop and classical-state-preserving closed-loop policies and present their structural results. Finally, we develop algorithms for computing optimal policies and value functions for both open-loop and classical-state-preserving closed-loop policies using the duality between dynamic programming and semi-definite programming formulations.

IEEE Conference on Decision and Control (CDC)Dec 16, 20240 citations

THEORY OF THE CONTROL OF OBSERVABLE QUANTUM SYSTEMS

V. P. Belavkin

Abstract. The fundamental mathematical definitions of the controlled feedback Markov dynamics of quantum-mechanical systems are introduced with regard to the dynamical reduction and filtering of quantum states in the course of quantum measurement in either discrete or continuous real time. The concept of sufficient coordinates for the description of a posteriori quantum states in a given class is introduced and it is proved that they form a classical Markov process with values in either state operators or state vector space. The general problem of optimal control of a quantum-mechanical system is discussed and the corresponding Bellman equation in the space of sufficient coordinates is derived. The results are illustrated in the example of control of the semigroup dynamics of a quantum system that is instantaneously observed at discrete times and evolves between measurement times according to the Schrődinger equation. 1.

Jan 1, 200556 citations

Dynamic Programming for Quantum State Preparation

Jincheng Zhang

Quantum state preparation is a critical component in many quantum algorithms, yet its complexity scales exponentially with the number of qubits and the desired state's complexity. This work presents a novel approach to quantum state preparation utilizing dynamic programming. We demonstrate that dynamic programming can efficiently determine optimal sequences of quantum gates to realize a target quantum state, significantly reducing the computational burden compared to exhaustive search methods. The core of our method lies in formulating the problem as a state-space optimization task, where each state represents a partial quantum state and the transition between states corresponds to applying a quantum gate. We detail the algorithm and provide a theoretical analysis of its performance, highlighting its potential to mitigate the exponential scaling issues inherent in traditional quantum state preparation techniques. This approach offers a practical and scalable solution for preparing complex quantum states, representing a significant advancement in the field.

Sep 6, 20260 citations