Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2405.17763

Capturing dynamics and thermodynamics of a three-level quantum heat engine via programmable quantum circuits

Gao-xiang Deng, Zhe He, Yu Liu, Wei Shao, Zheng Cui

Published May 28, 2024• 1 citation
arXivHTMLPDF

Abstract

This research employs the Kraus representation and Sz.-Nagy dilation theorem to model a three-level quantum heat on quantum circuits, investigating its dynamic evolution and thermodynamic performance. The feasibility of the dynamic model is validated by tracking the changes of population. On the basis of reinforcement learning algorithm, the optimal cycle of the quantum heat engine for maximal average power is proposed and verified by the thermodynamic model. The stability of quantum circuit simulations is scrutinized through a comparative analysis of theoretical and simulated results, predicated on an orthogonal test. These results affirm the practicality of simulating quantum heat engines on quantum circuits, offering potential for substantially curtailing the experimental expenses associated with the construction of such engines.

DOI
10.48550/arxiv.2405.17763

Related papers

Exploring the optimal cycle for a quantum heat engine using reinforcement learning

Gao-xiang Deng, Haoqiang Ai, Bingcheng Wang +3 more

Quantum thermodynamic relationships in emerging nanodevices are significant but often complex to deal with. The application of machine learning in quantum thermodynamics has provided a new perspective. This study employs reinforcement learning to output the optimal cycle of a quantum heat engine. Specifically, the soft actor-critic algorithm is adopted to optimize the cycle of a three-level coherent quantum heat engine with the aim of maximal average power. The results show that the optimal average output power of the coherent three-level heat engine is 1.28 times greater than the original cycle (steady limit). Meanwhile, the efficiency of the optimal cycle is greater than the Curzon-Ahlborn efficiency as well as efficiencies reported by other researchers. Notably, this optimal cycle can be fitted as an Otto-like cycle, which illustrates the effectiveness of the method.

arXiv:2308.06794•Physical Review A•Feb 28, 2024•9 citations

Identifying optimal cycles in quantum thermal machines with reinforcement-learning

Paolo Andrea Erdman, Frank Noé

Abstract The optimal control of open quantum systems is a challenging task but has a key role in improving existing quantum information processing technologies. We introduce a general framework based on reinforcement learning to discover optimal thermodynamic cycles that maximize the power of out-of-equilibrium quantum heat engines and refrigerators. We apply our method, based on the soft actor-critic algorithm, to three systems: a benchmark two-level system heat engine, where we find the optimal known cycle; an experimentally realistic refrigerator based on a superconducting qubit that generates coherence, where we find a non-intuitive control sequence that outperforms previous cycles proposed in literature; a heat engine based on a quantum harmonic oscillator, where we find a cycle with an elaborate structure that outperforms the optimized Otto cycle. We then evaluate the corresponding efficiency at maximum power.

arXiv:2108.13525•npj Quantum Information•Jan 10, 2022•109 citations

Experimental demonstration of steady-state dynamics of three-level quantum heat engine using superconducting quantum circuits

Gao-xiang Deng, Haoqiang Ai, Wei Shao +2 more

The three-level system represents the smallest quantum system capable of autonomous cycling in quantum heat engines. This study proposes a method to simulate the steady-state dynamics of a three-level quantum heat engine by designing and implementing superconducting quantum circuits. Following error mitigation, the outcomes from the quantum circuit model designed in this study, when executed on a real quantum device, closely align with theoretical predictions, thereby validating the effectiveness of the circuit model. This study offers a novel approach for investigating three-level quantum heat engines, enabling the verification of theoretical research findings while also reducing the complexity and cost of experimental procedures.

arXiv:2401.15833•Jan 29, 2024•0 citations

Initial demonstration of a quantum heat engine based on dissipation-engineered superconducting circuits

Tuomas Uusnäkki, Timm Mörstedt, Wallace S. Teixeira +2 more

Quantum heat engines require precise control over thermal reservoirs and the energies of the quantum working medium. Although superconducting circuits enable accurate engineering of controlled quantum systems, they have not yet been employed to experimentally realize a cyclic quantum heat engine. Here, we demonstrate a quantum heat engine with superconducting circuits, using a quantum-circuit refrigerator as a tunable heat reservoir and a flux-tunable transmon qubit as the working medium. Starting from a thermal state, we implement a few quantum Otto cycles with a tailored reservoir drive inducing sequential cooling and heating, interleaved with flux ramps controlling qubit frequency. Utilizing single-shot qubit readout, we monitor the qubit state evolution during the cycles and measure positive output powers and efficiencies, agreeing with corresponding simulations. Our results verify thermodynamic models of quantum heat engines, advance control of thermal environments, and open avenues for exploring possible quantum advantages.

arXiv:2502.20143•Nature Communications•May 5, 2026•9 citations

Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning

Paolo Andrea Erdman, Frank Noé

A quantum thermal machine is an open quantum system that enables the conversion between heat and work at the micro or nano-scale. Optimally controlling such out-of-equilibrium systems is a crucial yet challenging task with applications to quantum technologies and devices. We introduce a general model-free framework based on reinforcement learning to identify out-of-equilibrium thermodynamic cycles that are Pareto optimal tradeoffs between power and efficiency for quantum heat engines and refrigerators. The method does not require any knowledge of the quantum thermal machine, nor of the system model, nor of the quantum state. Instead, it only observes the heat fluxes, so it is both applicable to simulations and experimental devices. We test our method on a model of an experimentally realistic refrigerator based on a superconducting qubit, and on a heat engine based on a quantum harmonic oscillator. In both cases, we identify the Pareto-front representing optimal power-efficiency tradeoffs, and the corresponding cycles. Such solutions outperform previous proposals made in the literature, such as optimized Otto cycles, reducing quantum friction.

PNAS Nexus•Aug 1, 2023•13 citations

Autonomous quantum heat engine

Tuomas Uusnäkki, Miika Rasola, Vasilii Vadimov +3 more

Quantum heat engines provide attractive means in quantum thermodynamics for studying the fundamentals of the flow of heat and work. Previous experimental implementations of heat engines operating at the level of a few excitation quanta have utilized external driving, which has made the observation of the produced work challenging. Conversely, autonomous quantum heat engines only require a flow of heat to operate and generate work. However, autonomous quantum heat engines have not yet been experimentally demonstrated in any system despite numerous theoretical investigations. Here, we experimentally realize an autonomous quantum heat engine based on superconducting circuits. We construct the engine circuit implementing an approximate Otto cycle by coupling two superconducting resonators with a superconducting quantum interference device, and coupling this system to spectrally filtered hot and cold reservoirs. By varying the experimental conditions, we observe coherent microwave power generation arising from the internal dynamics of the system driven only by the thermal reservoirs. Our results validate previous theoretical predictions for this circuit and pave the way for detailed studies of quantum effects in heat engines and for using heat-generated coherent microwaves in circuit quantum electrodynamics.

quant-pharXiv:2603.15355•Mar 17, 2026•0 citations
This research employs the Kraus representation and Sz.-Nagy dilation theorem to model a three-level quantum heat on quantum circuits, investigating its dynamic evolution and thermodynamic performance. The feasibility of the dynamic model is validated by tracking the changes of population. On the basis of reinforcement learning algorithm, the optimal cycle of the quantum heat engine for maximal average power is proposed and verified by the thermodynamic model. The stability of quantum circuit simulations is scrutinized through a comparative analysis of theoretical and simulated results, predicated on an orthogonal test. These results affirm the practicality of simulating quantum heat engines on quantum circuits, offering potential for substantially curtailing the experimental expenses associated with the construction of such engines.
Quantum thermodynamic relationships in emerging nanodevices are significant but often complex to deal with. The application of machine learning in quantum thermodynamics has provided a new perspective. This study employs reinforcement learning to output the optimal cycle of a quantum heat engine. Specifically, the soft actor-critic algorithm is adopted to optimize the cycle of a three-level coherent quantum heat engine with the aim of maximal average power. The results show that the optimal average output power of the coherent three-level heat engine is 1.28 times greater than the original cycle (steady limit). Meanwhile, the efficiency of the optimal cycle is greater than the Curzon-Ahlborn efficiency as well as efficiencies reported by other researchers. Notably, this optimal cycle can be fitted as an Otto-like cycle, which illustrates the effectiveness of the method.
Abstract The optimal control of open quantum systems is a challenging task but has a key role in improving existing quantum information processing technologies. We introduce a general framework based on reinforcement learning to discover optimal thermodynamic cycles that maximize the power of out-of-equilibrium quantum heat engines and refrigerators. We apply our method, based on the soft actor-critic algorithm, to three systems: a benchmark two-level system heat engine, where we find the optimal known cycle; an experimentally realistic refrigerator based on a superconducting qubit that generates coherence, where we find a non-intuitive control sequence that outperforms previous cycles proposed in literature; a heat engine based on a quantum harmonic oscillator, where we find a cycle with an elaborate structure that outperforms the optimized Otto cycle. We then evaluate the corresponding efficiency at maximum power.
The three-level system represents the smallest quantum system capable of autonomous cycling in quantum heat engines. This study proposes a method to simulate the steady-state dynamics of a three-level quantum heat engine by designing and implementing superconducting quantum circuits. Following error mitigation, the outcomes from the quantum circuit model designed in this study, when executed on a real quantum device, closely align with theoretical predictions, thereby validating the effectiveness of the circuit model. This study offers a novel approach for investigating three-level quantum heat engines, enabling the verification of theoretical research findings while also reducing the complexity and cost of experimental procedures.
Quantum heat engines require precise control over thermal reservoirs and the energies of the quantum working medium. Although superconducting circuits enable accurate engineering of controlled quantum systems, they have not yet been employed to experimentally realize a cyclic quantum heat engine. Here, we demonstrate a quantum heat engine with superconducting circuits, using a quantum-circuit refrigerator as a tunable heat reservoir and a flux-tunable transmon qubit as the working medium. Starting from a thermal state, we implement a few quantum Otto cycles with a tailored reservoir drive inducing sequential cooling and heating, interleaved with flux ramps controlling qubit frequency. Utilizing single-shot qubit readout, we monitor the qubit state evolution during the cycles and measure positive output powers and efficiencies, agreeing with corresponding simulations. Our results verify thermodynamic models of quantum heat engines, advance control of thermal environments, and open avenues for exploring possible quantum advantages.
A quantum thermal machine is an open quantum system that enables the conversion between heat and work at the micro or nano-scale. Optimally controlling such out-of-equilibrium systems is a crucial yet challenging task with applications to quantum technologies and devices. We introduce a general model-free framework based on reinforcement learning to identify out-of-equilibrium thermodynamic cycles that are Pareto optimal tradeoffs between power and efficiency for quantum heat engines and refrigerators. The method does not require any knowledge of the quantum thermal machine, nor of the system model, nor of the quantum state. Instead, it only observes the heat fluxes, so it is both applicable to simulations and experimental devices. We test our method on a model of an experimentally realistic refrigerator based on a superconducting qubit, and on a heat engine based on a quantum harmonic oscillator. In both cases, we identify the Pareto-front representing optimal power-efficiency tradeoffs, and the corresponding cycles. Such solutions outperform previous proposals made in the literature, such as optimized Otto cycles, reducing quantum friction.
Quantum heat engines provide attractive means in quantum thermodynamics for studying the fundamentals of the flow of heat and work. Previous experimental implementations of heat engines operating at the level of a few excitation quanta have utilized external driving, which has made the observation of the produced work challenging. Conversely, autonomous quantum heat engines only require a flow of heat to operate and generate work. However, autonomous quantum heat engines have not yet been experimentally demonstrated in any system despite numerous theoretical investigations. Here, we experimentally realize an autonomous quantum heat engine based on superconducting circuits. We construct the engine circuit implementing an approximate Otto cycle by coupling two superconducting resonators with a superconducting quantum interference device, and coupling this system to spectrally filtered hot and cold reservoirs. By varying the experimental conditions, we observe coherent microwave power generation arising from the internal dynamics of the system driven only by the thermal reservoirs. Our results validate previous theoretical predictions for this circuit and pave the way for detailed studies of quantum effects in heat engines and for using heat-generated coherent microwaves in circuit quantum electrodynamics.