Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

CRC Press eBooks

Thermodynamics of information

James H. Luscombe

Published Apr 9, 2018• 3 citations
Publisher

Abstract

This chapter introduces the thermodynamics of information, a concept that finds wide use in physics and astrophysics. The link between physics and information began in 1867, with James Clerk Maxwell's thought experiment of a creature capable of beating the second law of thermodynamics. Entropy can therefore be said to represent the missing information about a system that can't be accounted for in macroscopic descriptions; the larger the entropy, the more the missing information. When Maxwell introduced the demon, the distribution of speeds of the atoms of a gas at a fixed temperature had only recently been established . The demon dies an entropic death because it must discard information previously collected. One may reasonably assume that a measurement procedure is fundamentally associated with a certain definite average entropy production, and that this restores concordance with the second law. The physicist Leo Szilard undertook a careful examination of the role played by the involvement of an observer.

DOI
10.1201/9780429507625-12

Related papers

Maxwell’s Demon and the Second Law

Harvey S. Leff

Maxwell’s demon emanates from a thought experiment proposed by James Clerk Maxwell in 1867 to illustrate the statistical nature of the second law of thermodynamics. Subsequently researchers wondered whether such a demon could in fact violate the second law. Leon Brillouin argued that the entropy produced during the demon’s measurement precluded such a violation. Years later Oliver Penrose and Charles Bennett observed (independently) that a Maxwell’s demon gathers information and stores it in a memory. Penrose showed that erasure of such a memory sends sufficient entropy to the environment to preclude violation of the second law. Notably this is so even when measurement produces arbitrarily little entropy. Bennett obtained the same result using Rolf Landauer’s seminal research on the thermodynamics of computation. The stunning shift in focus from measurement to erasure provided the impetus to better understand the role of information in quantum mechanics and thermodynamics. Indeed the linkage of information with physics is the principal legacy of Maxwell’s demon. Szilard’s one‐particle classical “gas” model and its quantum mechanical extension, together with postulated connections between entropy and algorithmic information, have provided useful insights. We review the long history of Maxwell’s demon and assess the current status of the second law in the context of the demon’s operations.

AIP conference proceedings•Jan 1, 2002•4 citations

Information in statistical physics

Roger Balian, Service De Physique Théorique

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and theoretical reasons, and a probabilistic description involving the observers is required. The criterion of maximum von Neumann entropy is then used for making reasonable inferences. It means that no spurious information is introduced besides the known data. Its outcomes can be given a direct justification based on the principle of indifference of Laplace. We introduce the concept of relevant entropy associated with some set of relevant variables; it characterizes the information that is missing at the microscopic level when only these variables are known. For equilibrium problems, the relevant variables are the conserved ones, and the Second Law is recovered as a second step of the inference process. For non-equilibrium problems, the increase of the relevant entropy expresses an irretrievable loss of information from the relevant variables towards the irrelevant ones. Two examples illustrate the flexibility of the choice of relevant variables and the multiplicity of the associated entropies: the thermodynamic entropy (satisfying the Clausius–Duhem inequality) and the Boltzmann entropy (satisfying the H-theorem). The identification of entropy with missing information is also supported by the paradox of Maxwell’s demon. Spin-echo experiments show that irreversibility itself is not an absolute concept: use of hidden information may overcome the arrow of time.

•Jul 26, 2013•0 citations

Maxwell’s demon and the management of ignorance in stochastic thermodynamics

Ian J. Ford

It is nearly 150 years since Maxwell challenged the validity of the second law of thermodynamics by imagining a tiny creature who could sort the molecules of a gas in such a way that would decrease entropy without exerting any work. The demon has been discussed largely using thought experiments, but it has recently become possible to exert control over nanoscale systems, just as Maxwell imagined, and the status of the second law has become a more practical matter, raising the issue of how measurements manage our ignorance in a way that can be exploited. The framework of stochastic thermodynamics extends macroscopic concepts such as heat, work, entropy and irreversibility to small systems and allows us explore the matter. Some arguments against a successful demon imply a second law that can be suspended indefinitely until we dissipate energy in order to remove the records of his operations. In contrast, under stochastic thermodynamics, the demon fails because on average, more work is performed upfront in making a measurement than can be extracted by exploiting the outcome. This requires us to exclude systems and a demon that evolve under what might be termed self-sorting dynamics, and we reflect on the constraints on control that this implies while still working within a thermodynamic framework.

arXiv:1510.03222•Contemporary Physics•Jan 20, 2016•7 citations

Maxwell’s Demon

Meir Hemmo, Orly Shenker

Demon, the famous thought experiment of James Clerk Maxwell, has been devised in 1867 as a counter example for the Second Law of thermodynamics. During the 140 years since the Demon was first suggested, numerous attempts have been made to counter Maxwell's argument. The attempts have been to show that Maxwell was wrong, since his Demon cannot work for one reason or another (see Leff and Rex 2003 for details and references). In this paper we show (following an argument by Albert 2000, Ch. 5.) that Maxwell was basically right, in the sense that his thought experiment is compatible with the laws of mechanics as well as with central principles of statistical mechanics. We then derive some (weak) restrictions on the Demon's efficiency. Finally, we prove that the Demon's cycle of operation can be completed (in particular, the Demon's memory can be erased) without increasing the total entropy of the universe. We draw some conclusions about the way to understand the meaning and role of probability in classical statistical mechanics

Oxford University Press eBooks•Mar 7, 2016•36 citations

Maxwell's Demon

Orly Shenker, Meir Hemmo

"Maxwell's Demon", the famous thought experiment of James Clerk Maxwell, has been devised in 1867 as a counter example for the Second Law of thermodynamics. During the 140 years since the Demon was first suggested, numerous attempts have been made to counter Maxwell's argument. The attempts have been to show that Maxwell was wrong, since his Demon cannot work for one reason or another (see Leff and Rex 2003 for details and references). In this paper we show (following an argument by Albert 2000, Ch. 5.) that Maxwell was basically right, in the sense that his thought experiment is compatible with the laws of mechanics as well as with central principles of statistical mechanics. We then derive some (weak) restrictions on the Demon's efficiency. Finally, we prove that the Demon's cycle of operation can be completed (in particular, the Demon's memory can be erased) without increasing the total entropy of the universe. We draw some conclusions about the way to understand the meaning and role of probability in classical statistical mechanics

•Dec 1, 2006•0 citations

Colloquium : The physics of Maxwell’s demon and information

Koji Maruyama, Franco Nori, Vlatko Vedral

Maxwell's demon was born in 1867 and still thrives in modern physics. He plays important roles in clarifying the connections between two theories: thermodynamics and information. Here the history of the demon and a variety of interesting consequences of the second law of thermodynamics are presented, mainly in quantum mechanics, but also in the theory of gravity. Also highlighted are some of the recent work that explores the role of information, illuminated by Maxwell's demon, in the arena of quantum-information theory.

arXiv:0707.3400•Reviews of Modern Physics•Jan 6, 2009•621 citations
This chapter introduces the thermodynamics of information, a concept that finds wide use in physics and astrophysics. The link between physics and information began in 1867, with James Clerk Maxwell's thought experiment of a creature capable of beating the second law of thermodynamics. Entropy can therefore be said to represent the missing information about a system that can't be accounted for in macroscopic descriptions; the larger the entropy, the more the missing information. When Maxwell introduced the demon, the distribution of speeds of the atoms of a gas at a fixed temperature had only recently been established . The demon dies an entropic death because it must discard information previously collected. One may reasonably assume that a measurement procedure is fundamentally associated with a certain definite average entropy production, and that this restores concordance with the second law. The physicist Leo Szilard undertook a careful examination of the role played by the involvement of an observer.
Maxwell’s demon emanates from a thought experiment proposed by James Clerk Maxwell in 1867 to illustrate the statistical nature of the second law of thermodynamics. Subsequently researchers wondered whether such a demon could in fact violate the second law. Leon Brillouin argued that the entropy produced during the demon’s measurement precluded such a violation. Years later Oliver Penrose and Charles Bennett observed (independently) that a Maxwell’s demon gathers information and stores it in a memory. Penrose showed that erasure of such a memory sends sufficient entropy to the environment to preclude violation of the second law. Notably this is so even when measurement produces arbitrarily little entropy. Bennett obtained the same result using Rolf Landauer’s seminal research on the thermodynamics of computation. The stunning shift in focus from measurement to erasure provided the impetus to better understand the role of information in quantum mechanics and thermodynamics. Indeed the linkage of information with physics is the principal legacy of Maxwell’s demon. Szilard’s one‐particle classical “gas” model and its quantum mechanical extension, together with postulated connections between entropy and algorithmic information, have provided useful insights. We review the long history of Maxwell’s demon and assess the current status of the second law in the context of the demon’s operations.
We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and theoretical reasons, and a probabilistic description involving the observers is required. The criterion of maximum von Neumann entropy is then used for making reasonable inferences. It means that no spurious information is introduced besides the known data. Its outcomes can be given a direct justification based on the principle of indifference of Laplace. We introduce the concept of relevant entropy associated with some set of relevant variables; it characterizes the information that is missing at the microscopic level when only these variables are known. For equilibrium problems, the relevant variables are the conserved ones, and the Second Law is recovered as a second step of the inference process. For non-equilibrium problems, the increase of the relevant entropy expresses an irretrievable loss of information from the relevant variables towards the irrelevant ones. Two examples illustrate the flexibility of the choice of relevant variables and the multiplicity of the associated entropies: the thermodynamic entropy (satisfying the Clausius–Duhem inequality) and the Boltzmann entropy (satisfying the H-theorem). The identification of entropy with missing information is also supported by the paradox of Maxwell’s demon. Spin-echo experiments show that irreversibility itself is not an absolute concept: use of hidden information may overcome the arrow of time.
It is nearly 150 years since Maxwell challenged the validity of the second law of thermodynamics by imagining a tiny creature who could sort the molecules of a gas in such a way that would decrease entropy without exerting any work. The demon has been discussed largely using thought experiments, but it has recently become possible to exert control over nanoscale systems, just as Maxwell imagined, and the status of the second law has become a more practical matter, raising the issue of how measurements manage our ignorance in a way that can be exploited. The framework of stochastic thermodynamics extends macroscopic concepts such as heat, work, entropy and irreversibility to small systems and allows us explore the matter. Some arguments against a successful demon imply a second law that can be suspended indefinitely until we dissipate energy in order to remove the records of his operations. In contrast, under stochastic thermodynamics, the demon fails because on average, more work is performed upfront in making a measurement than can be extracted by exploiting the outcome. This requires us to exclude systems and a demon that evolve under what might be termed self-sorting dynamics, and we reflect on the constraints on control that this implies while still working within a thermodynamic framework.
Demon, the famous thought experiment of James Clerk Maxwell, has been devised in 1867 as a counter example for the Second Law of thermodynamics. During the 140 years since the Demon was first suggested, numerous attempts have been made to counter Maxwell's argument. The attempts have been to show that Maxwell was wrong, since his Demon cannot work for one reason or another (see Leff and Rex 2003 for details and references). In this paper we show (following an argument by Albert 2000, Ch. 5.) that Maxwell was basically right, in the sense that his thought experiment is compatible with the laws of mechanics as well as with central principles of statistical mechanics. We then derive some (weak) restrictions on the Demon's efficiency. Finally, we prove that the Demon's cycle of operation can be completed (in particular, the Demon's memory can be erased) without increasing the total entropy of the universe. We draw some conclusions about the way to understand the meaning and role of probability in classical statistical mechanics
"Maxwell's Demon", the famous thought experiment of James Clerk Maxwell, has been devised in 1867 as a counter example for the Second Law of thermodynamics. During the 140 years since the Demon was first suggested, numerous attempts have been made to counter Maxwell's argument. The attempts have been to show that Maxwell was wrong, since his Demon cannot work for one reason or another (see Leff and Rex 2003 for details and references). In this paper we show (following an argument by Albert 2000, Ch. 5.) that Maxwell was basically right, in the sense that his thought experiment is compatible with the laws of mechanics as well as with central principles of statistical mechanics. We then derive some (weak) restrictions on the Demon's efficiency. Finally, we prove that the Demon's cycle of operation can be completed (in particular, the Demon's memory can be erased) without increasing the total entropy of the universe. We draw some conclusions about the way to understand the meaning and role of probability in classical statistical mechanics
Maxwell's demon was born in 1867 and still thrives in modern physics. He plays important roles in clarifying the connections between two theories: thermodynamics and information. Here the history of the demon and a variety of interesting consequences of the second law of thermodynamics are presented, mainly in quantum mechanics, but also in the theory of gravity. Also highlighted are some of the recent work that explores the role of information, illuminated by Maxwell's demon, in the arena of quantum-information theory.