Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Entropy

Boltzmann Configurational Entropy Revisited in the Framework of Generalized Statistical Mechanics

Antonio Maria Scarfone

Published Jan 18, 2022• 6 citations
Publisher

Abstract

As known, a method to introduce non-conventional statistics may be realized by modifying the number of possible combinations to put particles in a collection of single-particle states. In this paper, we assume that the weight factor of the possible configurations of a system of interacting particles can be obtained by generalizing opportunely the combinatorics, according to a certain analytical function f{π}(n) of the actual number of particles present in every energy level. Following this approach, the configurational Boltzmann entropy is revisited in a very general manner starting from a continuous deformation of the multinomial coefficients depending on a set of deformation parameters {π}. It is shown that, when f{π}(n) is related to the solutions of a simple linear difference-differential equation, the emerging entropy is a scaled version, in the occupational number representation, of the entropy of degree (κ,r) known, in the framework of the information theory, as Sharma-Taneja-Mittal entropic form.

DOI
10.3390/e24020140

Related papers

The Exact Entropy Formula of the Ideal Gas and its Information-Theoretic Interpretation

A. Spalvieri

The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation is that, under this assumption, whichever is the number of particles that constitute the system, the occupancy numbers of system's quantum (micro)states are multinomially distributed. This observation leads to an entropy formula for the physical system, which is nothing else than the entropy formula of the multinomial distribution, for which we claim novelty, in the sense that it is proposed here for the first time that the entropy of the multinomial distribution is the entropy of the physical system. The entropy formula of the multinomial distribution unveils yet unexplored connections between information theory and statistical mechanics, among which we mention the connection between conditional entropy of the random microstate given the random occupancy numbers and the Boltzmann-Planck entropy $\log(W)$ and between these two and the Gibbs correction term $\log(N!)$, thermalization and communication-theoretic preparation of a thermal state, accessible information of the thermal state and physical entropy of the thermalized system. A noticeable specific result that descends from our approach is the exact quantum correction to the textbook Sackur-Tetrode formula for the entropy of an ideal gas at the thermal equilibrium in a container.

arXiv:2305.04652•May 8, 2023•1 citation

Occupancy Statistics and Entropy in Bose Systems

A. Spalvieri

In this work, we compare three formulations of thermodynamic entropy for a non-interacting bosonic gas: (i) the grand-canonical Bose-Einstein entropy, (ii) the finite-N canonical entropy obtained from the exact partition function (Ziff, Uhlenbeck, and Kac construction), and (iii) the entropy of a multinomial distribution with Boltzmann categorical probabilities and temperature determined from Clausius' equation. It is well-known that the grand-canonical Bose-Einstein systematically overestimates entropy of canonical systems in regimes where particle-number fluctuations are significant. The exact canonical entropy correctly enforces the particle-number constraint, but recent experimental results suggest that it also overestimates particle-number fluctuations below the crossover temperature. The multinomial distribution is less common in thermodynamics. It addresses in a mathematically exact way the puzzle of the famous -log(N!) term introduced by Gibbs as a deus ex machina in discussions of thermodynamic entropy. One remarkable consequence is that the entropy of the multinomial distribution overcomes the issue of negative entropy at low temperature that affects the Gibbs and the Sackur-Tetrode entropies at low temperature. The analysis presented in the paper shows that the multinomial distribution, equipped with a categorical distribution calibrated in such a way that the resulting multinomial entropy fits Clausius' equation, provides accurate approximations to the canonical entropy in the classical regime, while it is smaller than the canonical entropy below the crossover temperature. One feature of the multinomial distribution is that it predicts lower peak variance of the number of particles in the ground state than the canonical distribution. This is in agreement with recent experimental results; hence, this paper identifies the thermodynamically calibrated multinomial distribution as a candidate alternative to the canonical distribution for thermodynamic bosonic entropy in finite systems.

Entropy•Aug 13, 2026•0 citations

A Nonlocal Formulation of Quantum Maximum Entropy Principle Including Fractional Exclusion Statistics

Massimo Trovato, Lino Reggiani, Viale A. Doria

In thermodynamics and statistical mechanics entropy is the fundamental physical quantity to describe the evolution of a statistical ensemble. Its microscopic definition was provided by Boltzmann through the celebrated expression S = kB ln Γ, where kB is the Boltzmann constant and Γ is the number of microstates exploiting the given macroscopic properties. In this context, it is well known that in classical mechanics the entropy: i) allows the violation of the uncertainty principle [1], [2]; ii) can be considered as a special case of the so-called Boltzmann-Gibbs-Shannon entropy that enables one to apply results of information theory to physics [1], [3]. In particular, by introducing the principle of maximum entropy (MEP) it was found possible to derive rigorous hydrodynamic (HD) models based on the moments of the distribution function to all orders of a power expansion and including appropriate closure conditions [4], [5]. Accordingly, making use of the Lagrange multipliers technique, it was found possible to construct the set of evolution equations for the macro-variables of interest. Apart from some partial attempts [3], [6], this is no longer the case in quantum mechanics. Here, the main difficulties concern with: i) the definition of a proper quantum entropy that includes particle indistinguishability; ii) the formulation of a global quantum MEP (QMEP) that allows one to obtain a quantum distribution function both for thermodynamic equilibrium and nonequilibrium configurations. From one hand, in the framework of a nonlocal quantum theory, the generalization of the corresponding Lagrange multipliers is also an open problem. Fron another hand, a rigorous formulation of quantum HD (QHD) closed models is a demanding issue for many kinds of problems in quantum systems like, interacting fermionic and bosonic gases, quantum turbulence, quantum fluids, quantized vortices, nuclear physics, confined carrier transport in semiconductor heterostrucures, phonon and electron transport in nanostructures, nanowires and thin layers. The aim of this talk is to address the above drawbacks by defining a quantum entropy in terms of the reduced density matrix, thus explicitly incorporating quantum statistics into problems involving a system of identical particles. As a further step, with respect to the uncertainty principle, starting from the Wigner representation we formulate a quantum maximum entropy principle which, in the framework of information theory, allows us to obtain a non-local theory for the system under study. As a final step, we determine a closed quantum hydrodynamic model for the macroscopic variables used as constraints in the QMEP approach.

•Jan 1, 2013•0 citations

Generalised partition functions: inferences on phase space distributions

Rudolf A Treumann, W. Baumjohann

Abstract. It is demonstrated that the statistical mechanical partition function can be used to construct various different forms of phase space distributions. This indicates that its structure is not restricted to the Gibbs–Boltzmann factor prescription which is based on counting statistics. With the widely used replacement of the Boltzmann factor by a generalised Lorentzian (also known as the q-deformed exponential function, where κ = 1∕|q − 1|, with κ, q ∈ R) both the kappa-Bose and kappa-Fermi partition functions are obtained in quite a straightforward way, from which the conventional Bose and Fermi distributions follow for κ → ∞. For κ ≠ ∞ these are subject to the restrictions that they can be used only at temperatures far from zero. They thus, as shown earlier, have little value for quantum physics. This is reasonable, because physical κ systems imply strong correlations which are absent at zero temperature where apart from stochastics all dynamical interactions are frozen. In the classical large temperature limit one obtains physically reasonable κ distributions which depend on energy respectively momentum as well as on chemical potential. Looking for other functional dependencies, we examine Bessel functions whether they can be used for obtaining valid distributions. Again and for the same reason, no Fermi and Bose distributions exist in the low temperature limit. However, a classical Bessel–Boltzmann distribution can be constructed which is a Bessel-modified Lorentzian distribution. Whether it makes any physical sense remains an open question. This is not investigated here. The choice of Bessel functions is motivated solely by their convergence properties and not by reference to any physical demands. This result suggests that the Gibbs–Boltzmann partition function is fundamental not only to Gibbs–Boltzmann but also to a large class of generalised Lorentzian distributions as well as to the corresponding nonextensive statistical mechanics.

arXiv:1604.05295•Annales Geophysicae•Jun 2, 2016•1 citation

Some convexity and subadditivity properties of entropy

Élliott H. Lieb

I. Introduction.Statistical mechanics is the science of explaining, predicting and understanding the gross, macroscopic attributes of matter (which may be taken to mean mechanical systems with essentially an infinite number of degrees of freedom) in terms of the elementary dynamical laws governing its atomic constituents.The problems that arise are sufficiently complex and intriguing, but at the same time sufficiently well posed, that the subject is nowadays as much a part of mathematics as of physics.The fields of information theory and ergodic theory had their genesis in statistical mechanical modes of thought and are now well established in the mathematics literature; there will be more to come.Ludwig Boltzmann, who died in 1906, was one of the principal founders of statistical mechanics, and his monument in Vienna contains the following eloquent testimonial to his scientific creativity:(1) S = k log W.Surely, this hypothesis of Boltzmann [1] is one of the most important and daring in statistical mechanics, for it relates S, the macroscopic entropy of a system, to W, the number of microscopic states of the system which have the same, given macroscopic properties.The number k is a universal constant, called Boltzmann's constant, and, for our purposes, we can consider it to be 1.In these lectures we shall explore some of the abstract properties of entropy, after first giving a precise formulation of it, and will include some recent results (with M. B. Ruskai) which extend formerly known facts about the strong subadditivity of entropy from the domain of classical mechanics to the quantum-mechanical domain.The presentation here will be sketchy and the reader is referred to the original papers [3], [4], [5] for more details.An expanded version of an invited address delivered before the M.I.T.

Bulletin of the American Mathematical Society•Jan 1, 1975•100 citations

Degeneracy, Average Occupancy and Microstates in Statistical Mechanics

Francesco R. Ruggeri

An interesting result arises in information theory, namely that if one considers a microstate with large N trials, each representing a state i with probability p(i), then even though this is only one of many possible microstates (each being a permutation of each other) it carries information about all of the permutations based on the average occupancy number. In particular, the probability of a microstate may be written as: Product over i p(ei) [power Np(ei) ] for large N. This holds for any microstate and so all have the same probability. Given that all of the microstates are permutations in the large N case, this probability is equivalent to 1/ {number of permutations} where Number of permutations = N! / { Product over i n(ei) }. We point out the above example, because it seems there are at least two main strategies in statistical mechanics. One is to begin with a set of average occupancy numbers n(ei/T) whose specific form is unknown. The idea then seems to be to seek degeneracy in the system, possibly among the arrangement of the n(ei)’s or degeneracy within single levels ei and to maximize the number of degenerate arrangements in order to account for as little information as possible. This approach may be used to calculate the Maxwell-Boltzmann, Fermi-Dirac and Bose-Einstein distributions. In the case of the latter two, degeneracy in the single energy levels ei is key. One then maximizes the ln of the degenerate arrangements subject to constraints such as Sum over i ei n(ei) and Sum over i n(ei) = N. The degeneracies themselves are associated with momentum degeneracies yielding the same energy. A completely different approach, it seems, is to consider exp(-(E-uN)/T) as representing the probability of a state with energy E and N particles and to use either the grand canonical ensemble i.e. sum the various exp(-(E-uN)/T)’s. These may then be broken into single particle sums using E(N) = sum over i ei n(ei) for n(ei) variable or sum over i ei for N fixed. Even though momentum degeneracy still exists, it is not part of the n sum of exp(-(E-uN)/T) factors which gives a single energy level probability distribution with no maximization necessary. Thus we point out that exp(-(E-uN)/T) for microstates seems to incorporate information about degeneracies without them needing to be explicitly added. On the other hand, if one starts with average n(ei) (without knowing their form), one must explicitly consider degeneracies in order to maximize so that there is no unnecessary information in the system. Both approaches should yield the same result. We consider the Bose-Einstein example of a photon gas as an example.

•May 15, 2023•0 citations
As known, a method to introduce non-conventional statistics may be realized by modifying the number of possible combinations to put particles in a collection of single-particle states. In this paper, we assume that the weight factor of the possible configurations of a system of interacting particles can be obtained by generalizing opportunely the combinatorics, according to a certain analytical function f{π}(n) of the actual number of particles present in every energy level. Following this approach, the configurational Boltzmann entropy is revisited in a very general manner starting from a continuous deformation of the multinomial coefficients depending on a set of deformation parameters {π}. It is shown that, when f{π}(n) is related to the solutions of a simple linear difference-differential equation, the emerging entropy is a scaled version, in the occupational number representation, of the entropy of degree (κ,r) known, in the framework of the information theory, as Sharma-Taneja-Mittal entropic form.
The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation is that, under this assumption, whichever is the number of particles that constitute the system, the occupancy numbers of system's quantum (micro)states are multinomially distributed. This observation leads to an entropy formula for the physical system, which is nothing else than the entropy formula of the multinomial distribution, for which we claim novelty, in the sense that it is proposed here for the first time that the entropy of the multinomial distribution is the entropy of the physical system. The entropy formula of the multinomial distribution unveils yet unexplored connections between information theory and statistical mechanics, among which we mention the connection between conditional entropy of the random microstate given the random occupancy numbers and the Boltzmann-Planck entropy log⁡(W)\log(W)log(W) and between these two and the Gibbs correction term log⁡(N!)\log(N!)log(N!), thermalization and communication-theoretic preparation of a thermal state, accessible information of the thermal state and physical entropy of the thermalized system. A noticeable specific result that descends from our approach is the exact quantum correction to the textbook Sackur-Tetrode formula for the entropy of an ideal gas at the thermal equilibrium in a container.
In this work, we compare three formulations of thermodynamic entropy for a non-interacting bosonic gas: (i) the grand-canonical Bose-Einstein entropy, (ii) the finite-N canonical entropy obtained from the exact partition function (Ziff, Uhlenbeck, and Kac construction), and (iii) the entropy of a multinomial distribution with Boltzmann categorical probabilities and temperature determined from Clausius' equation. It is well-known that the grand-canonical Bose-Einstein systematically overestimates entropy of canonical systems in regimes where particle-number fluctuations are significant. The exact canonical entropy correctly enforces the particle-number constraint, but recent experimental results suggest that it also overestimates particle-number fluctuations below the crossover temperature. The multinomial distribution is less common in thermodynamics. It addresses in a mathematically exact way the puzzle of the famous -log(N!) term introduced by Gibbs as a deus ex machina in discussions of thermodynamic entropy. One remarkable consequence is that the entropy of the multinomial distribution overcomes the issue of negative entropy at low temperature that affects the Gibbs and the Sackur-Tetrode entropies at low temperature. The analysis presented in the paper shows that the multinomial distribution, equipped with a categorical distribution calibrated in such a way that the resulting multinomial entropy fits Clausius' equation, provides accurate approximations to the canonical entropy in the classical regime, while it is smaller than the canonical entropy below the crossover temperature. One feature of the multinomial distribution is that it predicts lower peak variance of the number of particles in the ground state than the canonical distribution. This is in agreement with recent experimental results; hence, this paper identifies the thermodynamically calibrated multinomial distribution as a candidate alternative to the canonical distribution for thermodynamic bosonic entropy in finite systems.
In thermodynamics and statistical mechanics entropy is the fundamental physical quantity to describe the evolution of a statistical ensemble. Its microscopic definition was provided by Boltzmann through the celebrated expression S = kB ln Γ, where kB is the Boltzmann constant and Γ is the number of microstates exploiting the given macroscopic properties. In this context, it is well known that in classical mechanics the entropy: i) allows the violation of the uncertainty principle [1], [2]; ii) can be considered as a special case of the so-called Boltzmann-Gibbs-Shannon entropy that enables one to apply results of information theory to physics [1], [3]. In particular, by introducing the principle of maximum entropy (MEP) it was found possible to derive rigorous hydrodynamic (HD) models based on the moments of the distribution function to all orders of a power expansion and including appropriate closure conditions [4], [5]. Accordingly, making use of the Lagrange multipliers technique, it was found possible to construct the set of evolution equations for the macro-variables of interest. Apart from some partial attempts [3], [6], this is no longer the case in quantum mechanics. Here, the main difficulties concern with: i) the definition of a proper quantum entropy that includes particle indistinguishability; ii) the formulation of a global quantum MEP (QMEP) that allows one to obtain a quantum distribution function both for thermodynamic equilibrium and nonequilibrium configurations. From one hand, in the framework of a nonlocal quantum theory, the generalization of the corresponding Lagrange multipliers is also an open problem. Fron another hand, a rigorous formulation of quantum HD (QHD) closed models is a demanding issue for many kinds of problems in quantum systems like, interacting fermionic and bosonic gases, quantum turbulence, quantum fluids, quantized vortices, nuclear physics, confined carrier transport in semiconductor heterostrucures, phonon and electron transport in nanostructures, nanowires and thin layers. The aim of this talk is to address the above drawbacks by defining a quantum entropy in terms of the reduced density matrix, thus explicitly incorporating quantum statistics into problems involving a system of identical particles. As a further step, with respect to the uncertainty principle, starting from the Wigner representation we formulate a quantum maximum entropy principle which, in the framework of information theory, allows us to obtain a non-local theory for the system under study. As a final step, we determine a closed quantum hydrodynamic model for the macroscopic variables used as constraints in the QMEP approach.
Abstract. It is demonstrated that the statistical mechanical partition function can be used to construct various different forms of phase space distributions. This indicates that its structure is not restricted to the Gibbs–Boltzmann factor prescription which is based on counting statistics. With the widely used replacement of the Boltzmann factor by a generalised Lorentzian (also known as the q-deformed exponential function, where κ = 1∕|q − 1|, with κ, q ∈ R) both the kappa-Bose and kappa-Fermi partition functions are obtained in quite a straightforward way, from which the conventional Bose and Fermi distributions follow for κ → ∞. For κ ≠ ∞ these are subject to the restrictions that they can be used only at temperatures far from zero. They thus, as shown earlier, have little value for quantum physics. This is reasonable, because physical κ systems imply strong correlations which are absent at zero temperature where apart from stochastics all dynamical interactions are frozen. In the classical large temperature limit one obtains physically reasonable κ distributions which depend on energy respectively momentum as well as on chemical potential. Looking for other functional dependencies, we examine Bessel functions whether they can be used for obtaining valid distributions. Again and for the same reason, no Fermi and Bose distributions exist in the low temperature limit. However, a classical Bessel–Boltzmann distribution can be constructed which is a Bessel-modified Lorentzian distribution. Whether it makes any physical sense remains an open question. This is not investigated here. The choice of Bessel functions is motivated solely by their convergence properties and not by reference to any physical demands. This result suggests that the Gibbs–Boltzmann partition function is fundamental not only to Gibbs–Boltzmann but also to a large class of generalised Lorentzian distributions as well as to the corresponding nonextensive statistical mechanics.
I. Introduction.Statistical mechanics is the science of explaining, predicting and understanding the gross, macroscopic attributes of matter (which may be taken to mean mechanical systems with essentially an infinite number of degrees of freedom) in terms of the elementary dynamical laws governing its atomic constituents.The problems that arise are sufficiently complex and intriguing, but at the same time sufficiently well posed, that the subject is nowadays as much a part of mathematics as of physics.The fields of information theory and ergodic theory had their genesis in statistical mechanical modes of thought and are now well established in the mathematics literature; there will be more to come.Ludwig Boltzmann, who died in 1906, was one of the principal founders of statistical mechanics, and his monument in Vienna contains the following eloquent testimonial to his scientific creativity:(1) S = k log W.Surely, this hypothesis of Boltzmann [1] is one of the most important and daring in statistical mechanics, for it relates S, the macroscopic entropy of a system, to W, the number of microscopic states of the system which have the same, given macroscopic properties.The number k is a universal constant, called Boltzmann's constant, and, for our purposes, we can consider it to be 1.In these lectures we shall explore some of the abstract properties of entropy, after first giving a precise formulation of it, and will include some recent results (with M. B. Ruskai) which extend formerly known facts about the strong subadditivity of entropy from the domain of classical mechanics to the quantum-mechanical domain.The presentation here will be sketchy and the reader is referred to the original papers [3], [4], [5] for more details.An expanded version of an invited address delivered before the M.I.T.
An interesting result arises in information theory, namely that if one considers a microstate with large N trials, each representing a state i with probability p(i), then even though this is only one of many possible microstates (each being a permutation of each other) it carries information about all of the permutations based on the average occupancy number. In particular, the probability of a microstate may be written as: Product over i p(ei) [power Np(ei) ] for large N. This holds for any microstate and so all have the same probability. Given that all of the microstates are permutations in the large N case, this probability is equivalent to 1/ {number of permutations} where Number of permutations = N! / { Product over i n(ei) }. We point out the above example, because it seems there are at least two main strategies in statistical mechanics. One is to begin with a set of average occupancy numbers n(ei/T) whose specific form is unknown. The idea then seems to be to seek degeneracy in the system, possibly among the arrangement of the n(ei)’s or degeneracy within single levels ei and to maximize the number of degenerate arrangements in order to account for as little information as possible. This approach may be used to calculate the Maxwell-Boltzmann, Fermi-Dirac and Bose-Einstein distributions. In the case of the latter two, degeneracy in the single energy levels ei is key. One then maximizes the ln of the degenerate arrangements subject to constraints such as Sum over i ei n(ei) and Sum over i n(ei) = N. The degeneracies themselves are associated with momentum degeneracies yielding the same energy. A completely different approach, it seems, is to consider exp(-(E-uN)/T) as representing the probability of a state with energy E and N particles and to use either the grand canonical ensemble i.e. sum the various exp(-(E-uN)/T)’s. These may then be broken into single particle sums using E(N) = sum over i ei n(ei) for n(ei) variable or sum over i ei for N fixed. Even though momentum degeneracy still exists, it is not part of the n sum of exp(-(E-uN)/T) factors which gives a single energy level probability distribution with no maximization necessary. Thus we point out that exp(-(E-uN)/T) for microstates seems to incorporate information about degeneracies without them needing to be explicitly added. On the other hand, if one starts with average n(ei) (without knowing their form), one must explicitly consider degeneracies in order to maximize so that there is no unnecessary information in the system. Both approaches should yield the same result. We consider the Bose-Einstein example of a photon gas as an example.