Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Entropy

The Gibbs Paradox: Lessons from Thermodynamics

Janneke van Lith

Published Apr 30, 2018• 8 citations
Publisher

Abstract

The Gibbs paradox in statistical mechanics is often taken to indicate that already in the classical domain particles should be treated as fundamentally indistinguishable. This paper shows, on the contrary, how one can recover the thermodynamical account of the entropy of mixing, while treating states that only differ by permutations of similar particles as distinct. By reference to the orthodox theory of thermodynamics, it is argued that entropy differences are only meaningful if they are related to reversible processes connecting the initial and final state. For mixing processes, this means that processes should be considered in which particle number is allowed to vary. Within the context of statistical mechanics, the Gibbsian grandcanonical ensemble is a suitable device for describing such processes. It is shown how the grandcanonical entropy relates in the appropriate way to changes of other thermodynamical quantities in reversible processes, and how the thermodynamical account of the entropy of mixing is recovered even when treating the particles as distinguishable.

DOI
10.3390/e20050328

Related papers

Yet another resolution of the Gibbs paradox: an information theory approach

Chih‐Yuan Tseng

The “Gibbs Paradox” refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to count states in systems of identical particles. Several authors have recognized that the paradox is resolved once it is realized that there is no such thing as the entropy of a system, that there are many entropies, and that the choice between treating particles as being distinguishable or not depends on the resolution of the experiment. The purpose of this note is essentially pedagogical; we add to their analysis by examining the paradox from the point of view of information theory. Our argument is based on that ‘grouping’ property of entropy that Shannon recognized, by including it among his axioms, as an essential requirement on any measure of information. Not only does it provide the right connection between different entropies but, in addition, it draws our attention to the obvious fact that addressing issues of distinguishability and of counting states requires a clear idea about what precisely do we mean by a state.

arXiv:cond-mat/0109324•AIP conference proceedings•Jan 1, 2002•18 citations

Comment on “The Gibbs paradox and the distinguishability of identical particles,” by M. A. M. Versteegh and D. Dieks [Am. J. Phys. 79, 741–746 (2011)]

David S. Corti

We revisit recent discussions concerning the Gibbs paradox—the apparent discrepancy between the entropy change upon mixing identical gases as evaluated from the statistical mechanics of classical distinguishable particles and macroscopic thermodynamics. Contrary to what is often stated, we show that thermodynamics does not require this entropy of mixing to be zero. A zero value follows from the implicit assumption that the identical gas particles are indistinguishable. If the identical particles are explicitly assumed to be distinguishable, thermodynamics yields the same entropy of mixing as classical statistical mechanics.

American Journal of Physics•Jan 20, 2012•8 citations

The Gibbs paradox and the physical criteria for indistinguishability of identical particles

C. S. Unnikrishnan

Gibbs paradox in the context of statistical mechanics addresses the issue of additivity of entropy of mixing gases. The usual discussion attributes the paradoxical situation to classical distinguishability of identical particles and credits quantum theory for enabling indistinguishability of identical particles to solve the problem. We argue that indistinguishability of identical particles is already a feature in classical mechanics and this is clearly brought out when the problem is treated in the language of information and associated entropy. We pinpoint the physical criteria for indistinguishability that is crucial for the treatment of the Gibbs’ problem and the consistency of its solution with conventional thermodynamics. Quantum mechanics provides a quantitative criterion, not possible in the classical picture, for the degree of indistinguishability in terms of visibility of quantum interference, or overlap of the states as pointed out by von Neumann, thereby endowing the entropy expression with mathematical continuity and physical reasonableness.

arXiv:1811.03967•International Journal of Quantum Information•Aug 18, 2016•1 citation

The Gibbs paradox and the distinguishability of identical particles

Marijn A. M. Versteegh, Dennis Dieks

Identical classical particles are distinguishable. This distinguishability affects the number of ways W a macrostate can be realized on the microlevel, and from the relation S=k ln W leads to a nonextensive expression for the entropy. This result is usually considered incorrect because of its inconsistency with thermodynamics. It is sometimes concluded from this inconsistency that identical particles are fundamentally indistinguishable and that quantum mechanics is indispensable for making sense of this inconsistency. In contrast, we argue that the classical statistics of distinguishable particles and the resulting nonextensive entropy function are perfectly acceptable from both a theoretical and an experimental perspective. The inconsistency with thermodynamics can be removed by taking into account that the entropy concept in statistical mechanics is not completely identical to the thermodynamical one. We observe that even identical quantum particles are in some cases distinguishable, and conclude that quantum mechanics is irrelevant to the Gibbs paradox.

arXiv:1012.4111•American Journal of Physics•Jun 17, 2011•44 citations

The Gibbs Paradox and Particle Individuality

Dennis Dieks

A consensus seems to have developed that the Gibbs paradox in classical thermodynamics (the discontinuous drop in the entropy of mixing when the mixed gases become equal to each other) is unmysterious: in any actual situation, two gases can be separated or not, and the associated harmless discontinuity from “yes” to “no” is responsible for the discontinuity. By contrast, the Gibbs paradox in statistical physics continues to attract attention. Here, the problem is that standard calculations in statistical mechanics predict a non-vanishing value of the entropy of mixing even when two gases of the same kind are mixed, in conflict with thermodynamic predictions. This version of the Gibbs paradox is often seen as a sign that there is something fundamentally wrong with either the traditional expression S=klnW or with the way W is calculated. It is the aim of this article to review the situation from the orthodox (as opposed to information theoretic) standpoint. We demonstrate how the standard formalism is not only fully capable of dealing with the paradox, but also provides an intuitively clear picture of the relevant physical mechanisms. In particular, we pay attention to the explanatory relevance of the existence of particle trajectories in the classical context. We also discuss how the paradox survives the transition to quantum mechanics, in spite of the symmetrization postulates.

Entropy•Jun 15, 2018•11 citations

On the Gibbs paradox: what does indistinguishability really mean?

Arthur M. Lesk

The Gibbs paradox concerns the entropy of mixing of ideal gases: although the entropy change of mixing samples of different gases is unequal to the entropy change of mixing samples of the same gas, it is not clear within the framework of classical thermodynamics how the identity of the particles effects the analysis. An explicit examination of the concept of indistinguishability can clarify some of the implications of the quantum-mechanical resolution of the Gibbs paradox.

Journal of Physics A Mathematical and General•Apr 1, 1980•10 citations
The Gibbs paradox in statistical mechanics is often taken to indicate that already in the classical domain particles should be treated as fundamentally indistinguishable. This paper shows, on the contrary, how one can recover the thermodynamical account of the entropy of mixing, while treating states that only differ by permutations of similar particles as distinct. By reference to the orthodox theory of thermodynamics, it is argued that entropy differences are only meaningful if they are related to reversible processes connecting the initial and final state. For mixing processes, this means that processes should be considered in which particle number is allowed to vary. Within the context of statistical mechanics, the Gibbsian grandcanonical ensemble is a suitable device for describing such processes. It is shown how the grandcanonical entropy relates in the appropriate way to changes of other thermodynamical quantities in reversible processes, and how the thermodynamical account of the entropy of mixing is recovered even when treating the particles as distinguishable.
The “Gibbs Paradox” refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to count states in systems of identical particles. Several authors have recognized that the paradox is resolved once it is realized that there is no such thing as the entropy of a system, that there are many entropies, and that the choice between treating particles as being distinguishable or not depends on the resolution of the experiment. The purpose of this note is essentially pedagogical; we add to their analysis by examining the paradox from the point of view of information theory. Our argument is based on that ‘grouping’ property of entropy that Shannon recognized, by including it among his axioms, as an essential requirement on any measure of information. Not only does it provide the right connection between different entropies but, in addition, it draws our attention to the obvious fact that addressing issues of distinguishability and of counting states requires a clear idea about what precisely do we mean by a state.
We revisit recent discussions concerning the Gibbs paradox—the apparent discrepancy between the entropy change upon mixing identical gases as evaluated from the statistical mechanics of classical distinguishable particles and macroscopic thermodynamics. Contrary to what is often stated, we show that thermodynamics does not require this entropy of mixing to be zero. A zero value follows from the implicit assumption that the identical gas particles are indistinguishable. If the identical particles are explicitly assumed to be distinguishable, thermodynamics yields the same entropy of mixing as classical statistical mechanics.
Gibbs paradox in the context of statistical mechanics addresses the issue of additivity of entropy of mixing gases. The usual discussion attributes the paradoxical situation to classical distinguishability of identical particles and credits quantum theory for enabling indistinguishability of identical particles to solve the problem. We argue that indistinguishability of identical particles is already a feature in classical mechanics and this is clearly brought out when the problem is treated in the language of information and associated entropy. We pinpoint the physical criteria for indistinguishability that is crucial for the treatment of the Gibbs’ problem and the consistency of its solution with conventional thermodynamics. Quantum mechanics provides a quantitative criterion, not possible in the classical picture, for the degree of indistinguishability in terms of visibility of quantum interference, or overlap of the states as pointed out by von Neumann, thereby endowing the entropy expression with mathematical continuity and physical reasonableness.
Identical classical particles are distinguishable. This distinguishability affects the number of ways W a macrostate can be realized on the microlevel, and from the relation S=k ln W leads to a nonextensive expression for the entropy. This result is usually considered incorrect because of its inconsistency with thermodynamics. It is sometimes concluded from this inconsistency that identical particles are fundamentally indistinguishable and that quantum mechanics is indispensable for making sense of this inconsistency. In contrast, we argue that the classical statistics of distinguishable particles and the resulting nonextensive entropy function are perfectly acceptable from both a theoretical and an experimental perspective. The inconsistency with thermodynamics can be removed by taking into account that the entropy concept in statistical mechanics is not completely identical to the thermodynamical one. We observe that even identical quantum particles are in some cases distinguishable, and conclude that quantum mechanics is irrelevant to the Gibbs paradox.
A consensus seems to have developed that the Gibbs paradox in classical thermodynamics (the discontinuous drop in the entropy of mixing when the mixed gases become equal to each other) is unmysterious: in any actual situation, two gases can be separated or not, and the associated harmless discontinuity from “yes” to “no” is responsible for the discontinuity. By contrast, the Gibbs paradox in statistical physics continues to attract attention. Here, the problem is that standard calculations in statistical mechanics predict a non-vanishing value of the entropy of mixing even when two gases of the same kind are mixed, in conflict with thermodynamic predictions. This version of the Gibbs paradox is often seen as a sign that there is something fundamentally wrong with either the traditional expression S=klnW or with the way W is calculated. It is the aim of this article to review the situation from the orthodox (as opposed to information theoretic) standpoint. We demonstrate how the standard formalism is not only fully capable of dealing with the paradox, but also provides an intuitively clear picture of the relevant physical mechanisms. In particular, we pay attention to the explanatory relevance of the existence of particle trajectories in the classical context. We also discuss how the paradox survives the transition to quantum mechanics, in spite of the symmetrization postulates.