Connections between information theory and thermodynamics have proven to be very useful to establish bounding limits for physical processes. Ideas such as Landauer's erasure principle and information-assisted work extraction have greatly contributed not only to broadening our understanding about the fundamental limits imposed by nature, but also paving the way for practical implementations of information-processing devices. The intricate information-thermodynamics relation also entails a fundamental limit on parameter estimation, establishing a thermodynamic cost for information acquisition. We show that the amount of information that can be encoded in a physical system by means of a unitary process is limited by the dissipated work during the implementation of the process. This includes a thermodynamic tradeoff for information acquisition. Likewise, the information acquisition process is ultimately limited by the second law of thermodynamics. This tradeoff for information acquisition may find applications in several areas of knowledge.
Connections between information theory and thermodynamics have proven to be very useful to establish bounding limits for physical processes. Ideas such as Landauer's erasure principle and information-assisted work extraction have greatly contributed not only to broadening our understanding about the fundamental limits imposed by nature, but also paving the way for practical implementations of information-processing devices. The intricate information-thermodynamics relation also entails a fundamental limit on parameter estimation, establishing a thermodynamic cost for information acquisition. We show that the amount of information that can be encoded in a physical system by means of a unitary process is limited by the dissipated work during the implementation of the process. This includes a thermodynamic tradeoff for information acquisition. Likewise, the information acquisition process is ultimately limited by the second law of thermodynamics. This tradeoff for information acquisition may find applications in several areas of knowledge.
We review a general theory of thermodynamics of information processing. The background of this topic is the recently-developed nonequilibrium statistical mechanics and quantum (and classical) information theory. These theories are closely related to the modern technologies to manipulate and observe small systems; for example, macromolecules and colloidal particles in the classical regime, and quantum-optical systems and quantum dots in the quantum regime. First, we review a generalization of the second law of thermodynamics to the situations in which small thermodynamic systems are subject to quantum feedback control. The generalized second law is expressed in terms of an inequality that includes the term of information obtained by the measurement, as well as the thermodynamic quantities such as the free energy. This inequality leads to the fundamental upper bound of the work that can be extracted by a “Maxwell's demon”, which can be regarded as a feedback controller with a memory that stores measurement outcomes. Second, we review generalizations of the second law of thermodynamics to the measurement and information erasure processes of the memory of the demon that is a quantum system. The generalized second laws consist of inequalities that identify the lower bounds of the energy costs that are needed for the measurement and the information erasure. The inequality for the erasure leads to the celebrated Landauer's principle for a special case. Moreover, these inequalities enable us to reconcile Maxwell's demon with the second law of thermodynamics. In these inequalities, thermodynamic quantities and information contents are treated on an equal footing. In fact, the inequalities are model-independent, so that they can be applied to a broad class of information processing. Therefore, these inequalities can be called the second law of “information thermodynamics”.
The Landauer's principle, a cornerstone of information thermodynamics, provides a fundamental lower bound on the energetic cost of information erasure in terms of the information content change. However, its traditional formulation is largely confined to systems exchanging solely energy with an ideal thermal bath. In this work, we derive general information-cost trade-off relations that go beyond the scope of Landauer's principle by developing a thermodynamic inference approach based on the maximum entropy principle. These relations require only information about the system and are applicable to complex quantum scenarios involving multiple conserved charges and non-thermal environments. Specifically, we present two key results: (i) In scenarios where only the mean values of observables are accessible, we derive an information-content-informed upper bound on the thermodynamic cost which complements an existing generalized Landauer lower bound. (ii) When second-order fluctuations can also be measured, we obtain an information-content-informed lower bound on the change in variances of observables, thereby extending the Landauer's principle to constrain higher-order fluctuation costs. We numerically validate our information-cost trade-off relations using a coupled-qubit system exchanging energy and excitations, a driven qubit implementing an information erasure process, and a driven double quantum dot system that can operate as an inelastic heat engine. Our results underscore the broad utility of maximum-entropy inference in constraining thermodynamic costs for generic finite-time quantum processes, with direct relevance to quantum information processing and quantum thermodynamic applications.
Thermodynamics and information have intricate interrelations. Often thermodynamics is considered to be the logical premise to justify that information is physical - through Landauer's principle -, thereby also linking information and thermodynamics. This approach towards information has been instrumental to understand thermodynamics of logical and physical processes, both in the classical and quantum domain. In the present work, we formulate thermodynamics as an exclusive consequence of information conservation. The framework can be applied to the most general situations, beyond the traditional assumptions in thermodynamics: we allow systems and thermal baths to be quantum, of arbitrary sizes and even possessing inter-system correlations.Here, systems and baths are not treated differently, rather both are considered on an equal footing. This leads us to introduce a ''temperature''-independent formulation of thermodynamics. We rely on the fact that, for a fixed amount of information, measured by the von Neumann entropy, any system can be transformed to a state with the same entropy that possesses minimal energy. This state, known as a completely passive state, acquires Boltzmann-Gibbs canonical form with an intrinsic temperature . We introduce the notions of bound and free energy and use them to quantify heat and work, respectively. Guided by the principle of information conservation, we develop universal notions of equilibrium, heat and work, Landauer's principle and universal fundamental laws of thermodynamics. We demonstrate that the maximum efficiency of a quantum engine with a finite bath is in general lower than that of an ideal Carnot engine. We introduce a resource theoretic framework for our intrinsic temperature based thermodynamics, within which we address the problem of work extraction and state transformations. Finally, the framework is extended to multiple conserved quantities.
Irreversibility has a fundamental thermodynamic cost, erasing information inevitably generates heat. This connection is quantified by the Landauer bound, which gives the minimum dissipation needed to erase a single bit of information. While this bound applies in both classical and quantum settings, it is saturated only in idealised limits of infinite resources. Here, we provide a unified first principles description of finite-resource erasure in both classical and quantum systems. We begin by proving the communal folklore that in the idealised regime the erasure cost of a bit encoded in a quantum or classical system is the same. Despite this, we show that their practical implementation differs substantially: achieving comparable erasure quality in quantum systems requires more control, larger accessible energy gaps and longer operation times. Classical protocols can achieve the erasure of a comparable quantum protocol under far weaker constraints which we expose in trade-off relations. Our results explain why practical erasure schemes fall short of Landauer's bound and show that classical systems enjoy several fundamental thermodynamic advantages.
Thermodynamics and information have intricate interrelations. Often thermodynamics is considered to be the logical premise to justify that information is physical - through Landauer's principle -, thereby also linking information and thermodynamics. This approach towards information has been instrumental to understand thermodynamics of logical and physical processes, both in the classical and quantum domain. In the present work, we formulate thermodynamics as an exclusive consequence of information conservation. The framework can be applied to the most general situations, beyond the traditional assumptions in thermodynamics: we allow systems and thermal baths to be quantum, of arbitrary sizes and even possessing inter-system correlations.Here, systems and baths are not treated differently, rather both are considered on an equal footing. This leads us to introduce a ''temperature''-independent formulation of thermodynamics. We rely on the fact that, for a fixed amount of information, measured by the von Neumann entropy, any system can be transformed to a state with the same entropy that possesses minimal energy. This state, known as a completely passive state, acquires Boltzmann-Gibbs canonical form with an intrinsic temperature. We introduce the notions of bound and free energy and use them to quantify heat and work, respectively. Guided by the principle of information conservation, we develop universal notions of equilibrium, heat and work, Landauer's principle and universal fundamental laws of thermodynamics. We demonstrate that the maximum efficiency of a quantum engine with a finite bath is in general lower than that of an ideal Carnot engine. We introduce a resource theoretic framework for our intrinsic temperature based thermodynamics, within which we address the problem of work extraction and state transformations. Finally, the framework is extended to multiple conserved quantities.
Information-theoretic approaches provide a promising avenue for extending the laws of thermodynamics to the nanoscale. Here, we provide a general fundamental lower limit, valid for systems with an arbitrary Hamiltonian and in contact with any thermodynamic bath, on the work cost for the implementation of any logical process. This limit is given by a new information measure—the coherent relative entropy—which accounts for the Gibbs weight of each microstate. The coherent relative entropy enjoys a collection of natural properties justifying its interpretation as a measure of information and can be understood as a generalization of a quantum relative entropy difference. As an application, we show that the standard first and second laws of thermodynamics emerge from our microscopic picture in the macroscopic limit. Finally, our results have an impact on understanding the role of the observer in thermodynamics: Our approach may be applied at any level of knowledge—for instance, at the microscopic, mesoscopic, or macroscopic scales—thus providing a formulation of thermodynamics that is inherently relative to the observer. We obtain a precise criterion for when the laws of thermodynamics can be applied, thus making a step forward in determining the exact extent of the universality of thermodynamics and enabling a systematic treatment of Maxwell-demon-like situations.