Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

American Journal of Physics

Forces, Uncertainty, and the Gibbs Entropy

Ralph F. Baierlein

Published Jul 1, 1968• 10 citations
Publisher

Abstract

A physicist's educated intuition indicates that the presence of some readily analyzed forces in a gas reduces one's uncertainty about the actual state of affairs at the molecular level below the corresponding uncertainty in the absence of such forces. There ought to be a connection with at least one of the entropylike expressions appearing in statistical mechanics. A simple proof is given that, in the classical limit, the presence of any forces (represented by potentials dependent on particle positions only) does reduce the Gibbs entropy below its value, at the same temperature, in the absence of such forces. This may be taken as support for an interpretation of the Gibbs entropy as a measure of one's uncertainty about the actual microscopic situation, given the information typically available.

DOI
10.1119/1.1975035

Related papers

The Gibbs Paradox and Particle Individuality

Dennis Dieks

A consensus seems to have developed that the Gibbs paradox in classical thermodynamics (the discontinuous drop in the entropy of mixing when the mixed gases become equal to each other) is unmysterious: in any actual situation, two gases can be separated or not, and the associated harmless discontinuity from “yes” to “no” is responsible for the discontinuity. By contrast, the Gibbs paradox in statistical physics continues to attract attention. Here, the problem is that standard calculations in statistical mechanics predict a non-vanishing value of the entropy of mixing even when two gases of the same kind are mixed, in conflict with thermodynamic predictions. This version of the Gibbs paradox is often seen as a sign that there is something fundamentally wrong with either the traditional expression S=klnW or with the way W is calculated. It is the aim of this article to review the situation from the orthodox (as opposed to information theoretic) standpoint. We demonstrate how the standard formalism is not only fully capable of dealing with the paradox, but also provides an intuitively clear picture of the relevant physical mechanisms. In particular, we pay attention to the explanatory relevance of the existence of particle trajectories in the classical context. We also discuss how the paradox survives the transition to quantum mechanics, in spite of the symmetrization postulates.

Entropy•Jun 15, 2018•12 citations

Another look at the quantum mechanical entropy of mixing

Dennis Dieks, Vincent van Dijk

It is often stated that the Gibbs ‘‘paradox’’ is resolved or at least alleviated in quantum mechanics because the value of the quantum mechanical entropy of mixing continuously approaches zero if the difference between the particles that are being mixed is made to vanish (i.e., if the value of the inproduct of the respective quantum states goes to one). In this article, the justification of that claim is discussed. It is pointed out that, strictly speaking, an entropy of mixing is not defined if the quantum states of the particles are no longer orthogonal. It seems, therefore, that from a fundamental point of view the Gibbs ‘‘paradox’’ is there no less in quantum mechanics than in classical statistical mechanics.

American Journal of Physics•May 1, 1988•18 citations

The Gibbs Paradox: Lessons from Thermodynamics

Janneke van Lith

The Gibbs paradox in statistical mechanics is often taken to indicate that already in the classical domain particles should be treated as fundamentally indistinguishable. This paper shows, on the contrary, how one can recover the thermodynamical account of the entropy of mixing, while treating states that only differ by permutations of similar particles as distinct. By reference to the orthodox theory of thermodynamics, it is argued that entropy differences are only meaningful if they are related to reversible processes connecting the initial and final state. For mixing processes, this means that processes should be considered in which particle number is allowed to vary. Within the context of statistical mechanics, the Gibbsian grandcanonical ensemble is a suitable device for describing such processes. It is shown how the grandcanonical entropy relates in the appropriate way to changes of other thermodynamical quantities in reversible processes, and how the thermodynamical account of the entropy of mixing is recovered even when treating the particles as distinguishable.

Entropy•Apr 30, 2018•8 citations

Bits more basic for physics than fundamental particles

Bengt-Arne Vedin

There are several links between information theory — between »information as such« whatever that might mean — and the foundations of nature, i e, basic physics. Well, since physics a science still evolving (despite propositions that »the end of science« now in sight), some of the links between information and physics are hypothetical. One linkage fairly obvious — thermodynamics depends upon entropy or some measure of order or disorder, and that clearly has something to do with information. The other possible relationship might be between the uncertainty that a key characteristic of quantum mechanics. We can never know everything on the quantum scale; the Heisenberg uncertainty principle tells that the more information we gain in one direction the less we know in another. If we, on that scale, obtain certainty as to one factor, then another will stay entirely undecided — try to affix a position to a quantum particle, and the momentum will be out of bounds entirely. (This the established dogma currently, though there are some deviating ideas.1) Then the question arises: who does the actual measuring, with what — what particles, at what level, are involved in this act of, as it pronounced, forcing the wave function to collapse? This wave function is the indeterminate particle: the various statistics describing the probabilities that the particle (which simultaneously takes on aspects of a wave) may be in one state or another. We will now attempt to discuss these different — or are they really different? — interdependencies, starting with black holes.

Human IT•Jan 1, 1999•0 citations

Classical Resolution of the Gibbs Paradox from the Equal Probability Principle: An Informational Perspective

Zheng Zhang

The Gibbs paradox is a conventional paradox in classical statistical mechanics, typically resolved by invoking quantum indistinguishability through the 1/N! correction. In this letter, we present a resolution within classical ensemble theory, which relies solely on the equal probability principle and does not invoke the 1/N! correction. Our resolution can be naturally interpretated from a purely informational perspective, where the Gibbs entropy is explicitly regarded as the Shannon entropy, quantifying ignorance rather than disorder. From this informational perspective, we also clarify the connection between information and extractable work in the gas mixing processes. Our work opens a new avenue to reconsider the role of information in statistical mechanics.

arXiv:2602.06505•Feb 6, 2026•0 citations

Uncertainty, Entropy, and the Statistical Mechanics of Microscopic Systems

R. Blankenbecler, M. Hossein Partovi

Noting that quantum measurements are in general incomplete, we develop, starting from a recent entropic formulation of uncertainty, a maximum uncertainty principle to define the statistical mechanics of microscopic systems. The resulting ensemble entropy coincides with the expression of von Neumann, thus providing a unified, quantum basis for statistical physics of all systems. Examples involving momentum and position measurements are discussed.

Physical Review Letters•Feb 4, 1985•44 citations
A physicist's educated intuition indicates that the presence of some readily analyzed forces in a gas reduces one's uncertainty about the actual state of affairs at the molecular level below the corresponding uncertainty in the absence of such forces. There ought to be a connection with at least one of the entropylike expressions appearing in statistical mechanics. A simple proof is given that, in the classical limit, the presence of any forces (represented by potentials dependent on particle positions only) does reduce the Gibbs entropy below its value, at the same temperature, in the absence of such forces. This may be taken as support for an interpretation of the Gibbs entropy as a measure of one's uncertainty about the actual microscopic situation, given the information typically available.
A consensus seems to have developed that the Gibbs paradox in classical thermodynamics (the discontinuous drop in the entropy of mixing when the mixed gases become equal to each other) is unmysterious: in any actual situation, two gases can be separated or not, and the associated harmless discontinuity from “yes” to “no” is responsible for the discontinuity. By contrast, the Gibbs paradox in statistical physics continues to attract attention. Here, the problem is that standard calculations in statistical mechanics predict a non-vanishing value of the entropy of mixing even when two gases of the same kind are mixed, in conflict with thermodynamic predictions. This version of the Gibbs paradox is often seen as a sign that there is something fundamentally wrong with either the traditional expression S=klnW or with the way W is calculated. It is the aim of this article to review the situation from the orthodox (as opposed to information theoretic) standpoint. We demonstrate how the standard formalism is not only fully capable of dealing with the paradox, but also provides an intuitively clear picture of the relevant physical mechanisms. In particular, we pay attention to the explanatory relevance of the existence of particle trajectories in the classical context. We also discuss how the paradox survives the transition to quantum mechanics, in spite of the symmetrization postulates.
It is often stated that the Gibbs ‘‘paradox’’ is resolved or at least alleviated in quantum mechanics because the value of the quantum mechanical entropy of mixing continuously approaches zero if the difference between the particles that are being mixed is made to vanish (i.e., if the value of the inproduct of the respective quantum states goes to one). In this article, the justification of that claim is discussed. It is pointed out that, strictly speaking, an entropy of mixing is not defined if the quantum states of the particles are no longer orthogonal. It seems, therefore, that from a fundamental point of view the Gibbs ‘‘paradox’’ is there no less in quantum mechanics than in classical statistical mechanics.
The Gibbs paradox in statistical mechanics is often taken to indicate that already in the classical domain particles should be treated as fundamentally indistinguishable. This paper shows, on the contrary, how one can recover the thermodynamical account of the entropy of mixing, while treating states that only differ by permutations of similar particles as distinct. By reference to the orthodox theory of thermodynamics, it is argued that entropy differences are only meaningful if they are related to reversible processes connecting the initial and final state. For mixing processes, this means that processes should be considered in which particle number is allowed to vary. Within the context of statistical mechanics, the Gibbsian grandcanonical ensemble is a suitable device for describing such processes. It is shown how the grandcanonical entropy relates in the appropriate way to changes of other thermodynamical quantities in reversible processes, and how the thermodynamical account of the entropy of mixing is recovered even when treating the particles as distinguishable.
There are several links between information theory — between »information as such« whatever that might mean — and the foundations of nature, i e, basic physics. Well, since physics a science still evolving (despite propositions that »the end of science« now in sight), some of the links between information and physics are hypothetical. One linkage fairly obvious — thermodynamics depends upon entropy or some measure of order or disorder, and that clearly has something to do with information. The other possible relationship might be between the uncertainty that a key characteristic of quantum mechanics. We can never know everything on the quantum scale; the Heisenberg uncertainty principle tells that the more information we gain in one direction the less we know in another. If we, on that scale, obtain certainty as to one factor, then another will stay entirely undecided — try to affix a position to a quantum particle, and the momentum will be out of bounds entirely. (This the established dogma currently, though there are some deviating ideas.1) Then the question arises: who does the actual measuring, with what — what particles, at what level, are involved in this act of, as it pronounced, forcing the wave function to collapse? This wave function is the indeterminate particle: the various statistics describing the probabilities that the particle (which simultaneously takes on aspects of a wave) may be in one state or another. We will now attempt to discuss these different — or are they really different? — interdependencies, starting with black holes.
The Gibbs paradox is a conventional paradox in classical statistical mechanics, typically resolved by invoking quantum indistinguishability through the 1/N! correction. In this letter, we present a resolution within classical ensemble theory, which relies solely on the equal probability principle and does not invoke the 1/N! correction. Our resolution can be naturally interpretated from a purely informational perspective, where the Gibbs entropy is explicitly regarded as the Shannon entropy, quantifying ignorance rather than disorder. From this informational perspective, we also clarify the connection between information and extractable work in the gas mixing processes. Our work opens a new avenue to reconsider the role of information in statistical mechanics.