Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1902.07019 · Physical Review Letters

Machine Learning Non-Markovian Quantum Dynamics

I. A. Luchnikov, Stephen Vintskevich, D. A. Grigoriev, Sergey N. Filippov

Published Apr 9, 2020• 99 citations
arXivHTMLPDF

Abstract

Machine learning methods have proved to be useful for the recognition of patterns in statistical data. The measurement outcomes are intrinsically random in quantum physics, however, they do have a pattern when the measurements are performed successively on an open quantum system. This pattern is due to the system-environment interaction and contains information about the relaxation rates as well as non-Markovian memory effects. Here we develop a method to extract the information about the unknown environment from a series of projective single-shot measurements on the system (without resorting to the process tomography). The method is based on embedding the non-Markovian system dynamics into a Markovian dynamics of the system and the effective reservoir of finite dimension. The generator of Markovian embedding is learned by the maximum likelihood estimation. We verify the method by comparing its prediction with an exactly solvable non-Markovian dynamics. The developed algorithm to learn unknown quantum environments enables one to efficiently control and manipulate quantum systems.

DOI
10.1103/physrevlett.124.140502

Related papers

Machine learning of Markovian embedding for non-Markovian quantum dynamics

I. A. Luchnikov, Stephen Vintskevich, D. A. Grigoriev +1 more

Machine learning methods have proved to be useful for the recognition of patterns in statistical data. The measurement outcomes are intrinsically random in quantum physics, however, they do have a pattern when the measurements are performed successively on an open quantum system. This pattern is due to the system-environment interaction and contains information about the relaxation rates as well as non-Markovian memory effects. Here we develop a method to extract the information about the unknown environment from a series of projective single-shot measurements on the system (without resorting to the process tomography). The method is based on embedding the non-Markovian system dynamics into a Markovian dynamics of the system and the effective reservoir of finite dimension. The generator of Markovian embedding is learned by the maximum likelihood estimation. We verify the method by comparing its prediction with an exactly solvable non-Markovian dynamics. The developed algorithm to learn unknown quantum environments enables one to efficiently control and manipulate quantum systems.

•Feb 19, 2019•2 citations

Probing non-Markovian quantum dynamics with data-driven analysis: Beyond “black-box” machine-learning models

I. A. Luchnikov, Evgeniy O. Kiktenko, Maxim A. Gavreev +3 more

A precise understanding of the influence of a quantum system's environment on its dynamics, which is at the heart of the theory of open quantum systems, is crucial for further progress in the development of controllable large-scale quantum systems. However, existing approaches to account for complex system-environment interaction in the presence of memory effects are either based on heuristic and oversimplified principles or give rise to computational difficulties. In practice, one can leverage on available experimental data and replace first-principles simulations with a data-driven analysis that is often much simpler. Inspired by recent advances in data analysis and machine learning, we propose a data-driven approach to the analysis of the non-Markovian dynamics of open quantum systems. Our method allows, on the one hand, capturing the most important characteristics of open quantum systems such as the effective dimension of the environment and the spectrum of the joint system-environment quantum dynamics, and, on the other hand, reconstructing a predictive model of non-Markovian quantum dynamics, and denoising the measured quantum trajectories. We demonstrate the performance of the proposed approach with various models of open quantum systems, including a qubit coupled with a finite environment, a spin-boson model, and the damped Jaynes-Cummings model.

arXiv:2103.14490•Physical Review Research•Oct 3, 2022•23 citations

Non-Markovian Quantum Control via Model Maximum Likelihood Estimation and Reinforcement Learning

Tanmay Neema, Susmit Jha, Tuhin Sahai

Reinforcement Learning (RL) techniques have been increasingly applied in optimizing control systems. However, their application in quantum systems is hampered by the challenge of performing closed-loop control due to the difficulty in measuring these systems. This often leads to reliance on assumed models, introducing model bias, a problem that is exacerbated in open quantum dynamics where Markovian approximations are not valid. To address these challenges, we propose a novel approach that incorporates the non-Markovian nature of the environment into a low-dimensional effective reservoir. By initially employing a series of measurements as a 'dataset', we utilize machine learning techniques to learn the effective quantum dynamics more efficiently than traditional tomographic methods. Our methodology aims to demonstrates that by integrating reinforcement learning with model learning, it is possible to devise control policies and models that can counteract decoherence in a spin-boson system. This approach may not only mitigates the issues of model bias but also provides a more accurate representation of quantum dynamics, paving the way for more effective quantum control strategies.

arXiv:2402.05084•Feb 7, 2024•0 citations

Estimating the degree of non-Markovianity using machine learning

F. F. Fanchini, Göktuğ Karpat, Daniel Z. Rossatto +2 more

In the last few years, the application of machine learning methods has become increasingly relevant in different fields of physics. One of the most significant subjects in the theory of open quantum systems is the study of the characterization of non-Markovian memory effects that emerge dynamically throughout the time evolution of open systems as they interact with their surrounding environment. Here we consider two well-established quantifiers of the degree of memory effects, namely, the trace distance and the entanglement-based measures of non-Markovianity. We demonstrate that using machine learning techniques, in particular, support vector machine algorithms, it is possible to estimate the degree of non-Markovianity in two paradigmatic open system models with high precision. Our approach can be experimentally feasible to estimate the degree of non-Markovianity, since it requires a single or at most two rounds of state tomography.

arXiv:2009.03946•Physical Review A•Feb 24, 2021•27 citations

Unboxing Quantum Black Box Models: Learning Non-Markovian Dynamics

Stefan Krastanov, Kade Head-Marsden, Sisi Zhou +3 more

Characterizing the memory properties of the environment has become critical for the high-fidelity control of qubits and other advanced quantum systems. However, current non-Markovian tomography techniques are either limited to discrete superoperators, or they employ machine learning methods, neither of which provide physical insight into the dynamics of the quantum system. To circumvent this limitation, we design learning architectures that explicitly encode physical constraints like the properties of completely-positive trace-preserving maps in a differential form. This method preserves the versatility of the machine learning approach without sacrificing the efficiency and fidelity of traditional parameter estimation methods. Our approach provides the physical interpretability that machine learning and opaque superoperators lack. Moreover, it is aware of the underlying continuous dynamics typically disregarded by superoperator-based tomography. This paradigm paves the way to noise-aware optimal quantum control and opens a path to exploiting the bath as a control and error mitigation resource.

arXiv:2009.03902•Sep 8, 2020•8 citations

Data-driven learning of non-Markovian quantum dynamics

Samuel Goodwin, Brian K. McFarland, Manuel H. Muñoz-Arias +6 more

Fault-tolerant quantum computing requires extremely precise knowledge and control of qubit dynamics during the application of a gate. We develop a data-driven learning protocol for characterizing quantum gates that builds off previous work on learning the Nakajima-Mori-Zwanzig (NMZ) formulation of open system dynamics from time series data, which allows detailed reconstruction of quantum evolution, including non-Markovian dynamics. We demonstrate this learning technique on three different systems: a simulation of a qubit whose dynamics are purely Markovian, a simulation of a driven qubit coupled to stochastic noise produced by an Ornstein-Uhlenbeck process, and trapped-ion experimental data of a driven qubit whose noise environment is not characterized ahead of time. Our technique is able to learn the generators of time evolution, or the NMZ operators, in all three cases and can learn the timescale in which the qubit dynamics can no longer be accurately described by a purely Markovian model. Our technique complements existing quantum gate characterization methods such as gate set tomography by explicitly capturing non-Markovianity in the gate generator, thus allowing for more thorough diagnosis of noise sources.

quant-pharXiv:2601.07934•Jan 14, 2026•0 citations
Machine learning methods have proved to be useful for the recognition of patterns in statistical data. The measurement outcomes are intrinsically random in quantum physics, however, they do have a pattern when the measurements are performed successively on an open quantum system. This pattern is due to the system-environment interaction and contains information about the relaxation rates as well as non-Markovian memory effects. Here we develop a method to extract the information about the unknown environment from a series of projective single-shot measurements on the system (without resorting to the process tomography). The method is based on embedding the non-Markovian system dynamics into a Markovian dynamics of the system and the effective reservoir of finite dimension. The generator of Markovian embedding is learned by the maximum likelihood estimation. We verify the method by comparing its prediction with an exactly solvable non-Markovian dynamics. The developed algorithm to learn unknown quantum environments enables one to efficiently control and manipulate quantum systems.
Machine learning methods have proved to be useful for the recognition of patterns in statistical data. The measurement outcomes are intrinsically random in quantum physics, however, they do have a pattern when the measurements are performed successively on an open quantum system. This pattern is due to the system-environment interaction and contains information about the relaxation rates as well as non-Markovian memory effects. Here we develop a method to extract the information about the unknown environment from a series of projective single-shot measurements on the system (without resorting to the process tomography). The method is based on embedding the non-Markovian system dynamics into a Markovian dynamics of the system and the effective reservoir of finite dimension. The generator of Markovian embedding is learned by the maximum likelihood estimation. We verify the method by comparing its prediction with an exactly solvable non-Markovian dynamics. The developed algorithm to learn unknown quantum environments enables one to efficiently control and manipulate quantum systems.
A precise understanding of the influence of a quantum system's environment on its dynamics, which is at the heart of the theory of open quantum systems, is crucial for further progress in the development of controllable large-scale quantum systems. However, existing approaches to account for complex system-environment interaction in the presence of memory effects are either based on heuristic and oversimplified principles or give rise to computational difficulties. In practice, one can leverage on available experimental data and replace first-principles simulations with a data-driven analysis that is often much simpler. Inspired by recent advances in data analysis and machine learning, we propose a data-driven approach to the analysis of the non-Markovian dynamics of open quantum systems. Our method allows, on the one hand, capturing the most important characteristics of open quantum systems such as the effective dimension of the environment and the spectrum of the joint system-environment quantum dynamics, and, on the other hand, reconstructing a predictive model of non-Markovian quantum dynamics, and denoising the measured quantum trajectories. We demonstrate the performance of the proposed approach with various models of open quantum systems, including a qubit coupled with a finite environment, a spin-boson model, and the damped Jaynes-Cummings model.
Reinforcement Learning (RL) techniques have been increasingly applied in optimizing control systems. However, their application in quantum systems is hampered by the challenge of performing closed-loop control due to the difficulty in measuring these systems. This often leads to reliance on assumed models, introducing model bias, a problem that is exacerbated in open quantum dynamics where Markovian approximations are not valid. To address these challenges, we propose a novel approach that incorporates the non-Markovian nature of the environment into a low-dimensional effective reservoir. By initially employing a series of measurements as a 'dataset', we utilize machine learning techniques to learn the effective quantum dynamics more efficiently than traditional tomographic methods. Our methodology aims to demonstrates that by integrating reinforcement learning with model learning, it is possible to devise control policies and models that can counteract decoherence in a spin-boson system. This approach may not only mitigates the issues of model bias but also provides a more accurate representation of quantum dynamics, paving the way for more effective quantum control strategies.
In the last few years, the application of machine learning methods has become increasingly relevant in different fields of physics. One of the most significant subjects in the theory of open quantum systems is the study of the characterization of non-Markovian memory effects that emerge dynamically throughout the time evolution of open systems as they interact with their surrounding environment. Here we consider two well-established quantifiers of the degree of memory effects, namely, the trace distance and the entanglement-based measures of non-Markovianity. We demonstrate that using machine learning techniques, in particular, support vector machine algorithms, it is possible to estimate the degree of non-Markovianity in two paradigmatic open system models with high precision. Our approach can be experimentally feasible to estimate the degree of non-Markovianity, since it requires a single or at most two rounds of state tomography.
Characterizing the memory properties of the environment has become critical for the high-fidelity control of qubits and other advanced quantum systems. However, current non-Markovian tomography techniques are either limited to discrete superoperators, or they employ machine learning methods, neither of which provide physical insight into the dynamics of the quantum system. To circumvent this limitation, we design learning architectures that explicitly encode physical constraints like the properties of completely-positive trace-preserving maps in a differential form. This method preserves the versatility of the machine learning approach without sacrificing the efficiency and fidelity of traditional parameter estimation methods. Our approach provides the physical interpretability that machine learning and opaque superoperators lack. Moreover, it is aware of the underlying continuous dynamics typically disregarded by superoperator-based tomography. This paradigm paves the way to noise-aware optimal quantum control and opens a path to exploiting the bath as a control and error mitigation resource.
Fault-tolerant quantum computing requires extremely precise knowledge and control of qubit dynamics during the application of a gate. We develop a data-driven learning protocol for characterizing quantum gates that builds off previous work on learning the Nakajima-Mori-Zwanzig (NMZ) formulation of open system dynamics from time series data, which allows detailed reconstruction of quantum evolution, including non-Markovian dynamics. We demonstrate this learning technique on three different systems: a simulation of a qubit whose dynamics are purely Markovian, a simulation of a driven qubit coupled to stochastic noise produced by an Ornstein-Uhlenbeck process, and trapped-ion experimental data of a driven qubit whose noise environment is not characterized ahead of time. Our technique is able to learn the generators of time evolution, or the NMZ operators, in all three cases and can learn the timescale in which the qubit dynamics can no longer be accurately described by a purely Markovian model. Our technique complements existing quantum gate characterization methods such as gate set tomography by explicitly capturing non-Markovianity in the gate generator, thus allowing for more thorough diagnosis of noise sources.