One of the most popular methods for solving numerical optimal control problems is the Krotov method, adapted for quantum control by Tannor and coworkers. The Krotov method has the following three appealing properties: (1) monotonic increase of the objective with iteration number, (2) no requirement for a line search, leading to a significant savings over gradient (first-order) methods, and (3) macrosteps at each iteration, resulting in significantly faster growth of the objective at early iterations than in gradient methods where small steps are required. The principal drawback of the Krotov method is slow convergence at later iterations, which is particularly problematic when high fidelity is desired. We show here that, near convergence, the Krotov method degenerates to a first-order gradient method. We then present a variation on the Krotov method that has all the advantages of the original Krotov method but with significantly enhanced convergence (second-order or quasi-Newton) as the optimal solution is approached. We illustrate the method by controlling the three-dimensional dynamics of the valence electron in the Na atom.
One of the most popular methods for solving numerical optimal control problems is the Krotov method, adapted for quantum control by Tannor and coworkers. The Krotov method has the following three appealing properties: (1) monotonic increase of the objective with iteration number, (2) no requirement for a line search, leading to a significant savings over gradient (first-order) methods, and (3) macrosteps at each iteration, resulting in significantly faster growth of the objective at early iterations than in gradient methods where small steps are required. The principal drawback of the Krotov method is slow convergence at later iterations, which is particularly problematic when high fidelity is desired. We show here that, near convergence, the Krotov method degenerates to a first-order gradient method. We then present a variation on the Krotov method that has all the advantages of the original Krotov method but with significantly enhanced convergence (second-order or quasi-Newton) as the optimal solution is approached. We illustrate the method by controlling the three-dimensional dynamics of the valence electron in the Na atom.
The non-linear optimization method developed by A. Konnov and V. Krotov [Autom. Remote Cont. (Engl. Transl.) 60, 1427 (1999)] has been used previously to extend the capabilities of optimal control theory from the linear to the non-linear Schrödinger equation [S. E. Sklarz and D. J. Tannor, Phys. Rev. A 66, 053619 (2002)]. Here we show that based on the Konnov-Krotov method, monotonically convergent algorithms are obtained for a large class of quantum control problems. It includes, in addition to nonlinear equations of motion, control problems that are characterized by non-unitary time evolution, nonlinear dependencies of the Hamiltonian on the control, time-dependent targets, and optimization functionals that depend to higher than second order on the time-evolving states. We furthermore show that the nonlinear (second order) contribution can be estimated either analytically or numerically, yielding readily applicable optimization algorithms. We demonstrate monotonic convergence for an optimization functional that is an eighth-degree polynomial in the states. For the "standard" quantum control problem of a convex final-time functional, linear equations of motion and linear dependency of the Hamiltonian on the field, the second-order contribution is not required for monotonic convergence but can be used to speed up convergence. We demonstrate this by comparing the performance of first- and second-order algorithms for two examples.
This chapter is devoted to numerical optimization methods with a focus on solution schemes that are used in the framework of quantum control problems. We first discuss classical optimization schemes that require the computation of reduced gradients and usually provide first-order convergence to a local minimum. These methods are supported by a large set of theoretical results that provide guarantee of convergence to local minima. The second section is devoted to monotonic schemes that originate from the works of Vadim Fedorovitch Krotov. While these methods remain popular in the quantum control application communities, in other frameworks the methods of choice are those discussed in Section 6.1.
Optimal control theory is a powerful tool for solving control problems in quantum mechanics, ranging from the control of chemical reactions to the implementation of gates in a quantum computer. Gradient-based optimization methods are able to find high fidelity controls, but require considerable numerical effort and often yield highly complex solutions. We propose here to employ a two-stage optimization scheme to significantly speed up convergence and achieve simpler controls. The control is initially parametrized using only a few free parameters, such that optimization in this pruned search space can be performed with a simplex method. The result, considered now simply as an arbitrary function on a time grid, is the starting point for further optimization with a gradient-based method that can quickly converge to high fidelities. We illustrate the success of this hybrid technique by optimizing a geometric phase gate for two superconducting transmon qubits coupled with a shared transmission line resonator, showing that a combination of Nelder-Mead simplex and Krotov’s method yields considerably better results than either one of the two methods alone.
Some of the limitations of popular optimal control algorithms such as Lyapunov control, the Krotov method and other iterative algorithms based on functional gradients are considered. Lyapunov control, while elegant and generally effective for ideal systems, struggles for realistic systems. Iterative techniques such as the Krotov method tend to be more effective, but the inclusion of an energy penalty term implies that the resulting solutions are not critical points of the objective functional alone, and do not maximize it. These problems can be avoided by using functional gradients without penalty terms, but even these techniques fail for some problems.
The control of quantum dynamics is often concerned with finding time-dependent optimal control fields that can take a system from an initial state to a final state to attain the desired value of an observable. This paper presents a general method for formulating monotonically convergent algorithms to iteratively improve control fields. The formulation is based on a two-point boundary-value quantum control paradigm (TBQCP) expressed as a nonlinear integral equation of the first kind arising from dynamical invariant tracking control. TBQCP is shown to be related to various existing techniques, including local control theory, the Krotov method, and optimal control theory. Several accelerated monotonic convergence schemes for iteratively computing control fields are derived based on TBQCP. Numerical simulations are compared with the Krotov method showing that the new TBQCP schemes are efficient and remain monotonically convergent over a wide range of the iteration step parameters and the control pulse lengths, which is attributable to the trap-free character of the transition probability quantum dynamics control landscape.
Mathematical problems of optimal control of quantum systems attract high interest in connection with both fundamental questions and existing and prospective applications. An important problem is the development of methods for constructing controls for quantum systems. One of the widely used methods is the Krotov method. The article is the first part of the review devoted to mathematical aspects of this method for optimal control of quantum systems. Beyond quantum control this method was suggested in the articles [V.F. Krotov, I.N. Feldman, Eng. Cybern. 1983. Vol. 21, 123], [A.I. Konnov, V.F. Krotov, Automat. Remote Control, 1999], and then adopted to optimal quantum control in papers by V.A. Kazakov, V.F. Krotov, R. Kosloff, C.P. Koch, D.J. Tannor, and others. The review considers this method, including cases with constraints on control spectrum and on states of the quantum system, various ways for choosing the improvement function, in particular, linear or linear-quadratic form, etc. We also discuss GRAPE (GRadient Ascent Pulse Engineering) and CRAB (Chopped Random-Basis) methods, as well as combined methods such as the method suggested by I. Maday and G. Turinici for generalizing the 1st order Krotov method and the Zhu-Rabitz method. Nowadays, various versions of the Krotov method are used as a key tool in optimal quantum control, and the review describes applications of this method to mathematical control problems for molecular dynamics, Bose-Einstein condensate, nuclear-magnetic resonance, quantum gates generation, etc. The first part of the review is devoted to closed quantum systems.