Historically statistical mechanics was developed for gasses for which there are very large numbers of molecules (i.e. on the order of 10 to 23rd power). As a result factorial schemes were developed to count the number of arrangements possible, the ln taken of this result and Stirling’s approximation for large N applied. The Shannon’s entropy form S/(-k) = Sum over i P(ei)ln(P(ei)) is consistent with this large N approach. Furthermore, large N statistical mechanics was linked to thermodynamics, in particular the first law dE=TdS - PdV. Surprisingly then, statistical mechanical results were applied to systems with small numbers of particles (e.g. a nucleus with about 100 nucleons etc). In Parts I and II we argued that the first law of thermodynamics describes two separate kinds of changes associated with energy changes. The second, work, is linked to the change of a mechanical parameter such as the volume of a box etc. The energy of a bound quantum particle in a box with an infinite potential is proportional to nn/LL. Thus we argued that a pure quantum bound state may also be associated with the first law of thermodynamics with changes in L with n, the energy level, held constant representing pure work. We further argued that for a bound state two classical like probabilities exists P(x)=W(x)W(x) and P(p)=a(p)a(p) where W(x)=wavefunction = Sum over p a(p)exp(ipx) with P(x) being proportional to 1/L and P(p) to L. For a quantum adiabatic transformation (i.e. changing L with n staying constant) the term dS=0. If one wishes to create S from P(x) and P(p) and desires linearity i.e. S=Sp(n)+Sx, then Sp=Integral dp P(p)ln(P(p)) and Sx= Integral dx P(x) ln(P(x)) is a solution. If one next considers a quantum wavefunction for two levels W(x,t) = a(1)exp(-i E1 t) W1(x) + a(2) exp(-iE2 t) W2(x) with Eave = Sum over n en P(en) where Wn=a(n)a(n), one may again utilize the first law of thermodynamics. In Parts I and II we carried over the entropy form P(ei)ln(P(ei)). In this note we wish to argue that this form follows at the two energy level picture by considerations of a function which consists entirely of probabilities i.e. P(ei) and is linear in the sense that such a function for two identical two state systems should yield S1+S2 as the first law should apply to each system. Furthermore P(ei) should be a function of P(ei/T) where T is a parameter which behaves as 1/LL because ei is proportional to 1/LL. In this way any function of P(ei) remains unchanged under a quantum adiabatic transformation for which i’s stay constant, but L changes. As a result, the entropy at the quantum level seems to follow from such arguments and not from large N approximations of factorial counting approaches. In large N situations it is argued that P(ei)=C(T)exp(-ei/T) follows from maximizing S with respect to the form of P(ei) subject to constant average energy. For small N situations (e.g. the 2 level example) one may solve Sum over i ei d(a(i)a(i)) = T dS directly without maximization. The maximization approach follows directly from dE=TdS (work=0) because dE= Sum ei dP(ei) in such scenarios. This is of the form of a Lagrange constraint This has been pointed out in Part II. In this note, we argue that the maximization of entropy is not needed at all. For dE=Sum over i ei dP(ei) and the ln form of entropy P(ei) is the inverse function of ln. Thus we argue that linearity and not large N arguments are enough to obtain Shannon’s form of entropy and that this ln form suggests P(ei/T) = C(T)exp(-ei/T) if dE=Sum over ei dP(ei)= TdS (for dW=0). Thus maximization of entropy subject to constant average energy is also not needed (although it does follow mathematically from dE=TdS.)
Historically statistical mechanics was developed for gasses for which there are very large numbers of molecules (i.e. on the order of 10 to 23rd power). As a result factorial schemes were developed to count the number of arrangements possible, the ln taken of this result and Stirling’s approximation for large N applied. The Shannon’s entropy form S/(-k) = Sum over i P(ei)ln(P(ei)) is consistent with this large N approach. Furthermore, large N statistical mechanics was linked to thermodynamics, in particular the first law dE=TdS - PdV. Surprisingly then, statistical mechanical results were applied to systems with small numbers of particles (e.g. a nucleus with about 100 nucleons etc). In Parts I and II we argued that the first law of thermodynamics describes two separate kinds of changes associated with energy changes. The second, work, is linked to the change of a mechanical parameter such as the volume of a box etc. The energy of a bound quantum particle in a box with an infinite potential is proportional to nn/LL. Thus we argued that a pure quantum bound state may also be associated with the first law of thermodynamics with changes in L with n, the energy level, held constant representing pure work. We further argued that for a bound state two classical like probabilities exists P(x)=W(x)W(x) and P(p)=a(p)a(p) where W(x)=wavefunction = Sum over p a(p)exp(ipx) with P(x) being proportional to 1/L and P(p) to L. For a quantum adiabatic transformation (i.e. changing L with n staying constant) the term dS=0. If one wishes to create S from P(x) and P(p) and desires linearity i.e. S=Sp(n)+Sx, then Sp=Integral dp P(p)ln(P(p)) and Sx= Integral dx P(x) ln(P(x)) is a solution. If one next considers a quantum wavefunction for two levels W(x,t) = a(1)exp(-i E1 t) W1(x) + a(2) exp(-iE2 t) W2(x) with Eave = Sum over n en P(en) where Wn=a(n)a(n), one may again utilize the first law of thermodynamics. In Parts I and II we carried over the entropy form P(ei)ln(P(ei)). In this note we wish to argue that this form follows at the two energy level picture by considerations of a function which consists entirely of probabilities i.e. P(ei) and is linear in the sense that such a function for two identical two state systems should yield S1+S2 as the first law should apply to each system. Furthermore P(ei) should be a function of P(ei/T) where T is a parameter which behaves as 1/LL because ei is proportional to 1/LL. In this way any function of P(ei) remains unchanged under a quantum adiabatic transformation for which i’s stay constant, but L changes. As a result, the entropy at the quantum level seems to follow from such arguments and not from large N approximations of factorial counting approaches. In large N situations it is argued that P(ei)=C(T)exp(-ei/T) follows from maximizing S with respect to the form of P(ei) subject to constant average energy. For small N situations (e.g. the 2 level example) one may solve Sum over i ei d(a(i)a(i)) = T dS directly without maximization. The maximization approach follows directly from dE=TdS (work=0) because dE= Sum ei dP(ei) in such scenarios. This is of the form of a Lagrange constraint This has been pointed out in Part II. In this note, we argue that the maximization of entropy is not needed at all. For dE=Sum over i ei dP(ei) and the ln form of entropy P(ei) is the inverse function of ln. Thus we argue that linearity and not large N arguments are enough to obtain Shannon’s form of entropy and that this ln form suggests P(ei/T) = C(T)exp(-ei/T) if dE=Sum over ei dP(ei)= TdS (for dW=0). Thus maximization of entropy subject to constant average energy is also not needed (although it does follow mathematically from dE=TdS.)
In Part I we argued that both the first law of thermodynamics dE=TdS-dW and the form S/(-k) = Integral dp dx P(x)P(p) ln{P(x)P(p)} = Integral P(x)ln(P(x)) + Integral P(p) ln(P(p)) may be established at the level of a pure quantum bound state with P(x)=W(x)W(x) and P(p)=a(p)a(p) where W(x)=wavefunction = Sum over p a(p)exp(ipx). We further argued that S=Sp+Sx in order that L, the length of a box with infinite potential walls, should disappear (from S) so that a quantum adiabatic transformation where n=energy level remains constant is isentropic. In fact, we argued that the P(x)ln(P(x)) form follows from this rule and an assumption of additive entropies Sp and Sx. As a result, probability at the pure bound state level is not based on the maximization of entropy as P(x)=W(x)W(x) and P(p) =a(p)a(p) and W(x) follows from the solution of the time-independent Schrodinger equation. In this note we examine the case of two level bound state system (analyzed in (1)) to see how the thermodynamic temperature behaves in such a case and examine the maximization of entropy. T is already present in the pure energy state picture (TdS), but for two levels or more, it plays a different role in that P(ei) where ei is the ith energy level becomes a function of T which enters as a Lagrange multiple during the maximization of S with respect to P(ei) with the constraint Sum over i eiP(ei) = Eave. No such maximization of entropy occurs at the pure bound state level. We note, however, that for a quantum adiabatic transformation for a particle in a box with infinite potential walls, P(ei) values must remain constant as L changes. Ei is proportional to 1/LL so a solution is to use ei/T with T is proportional to 1/LL. Thus the parameter T already enters P(ei) in order to ensure that an adiabatic transformation is isentropic. In the pure bound state, one was forced to use P(x)P(p)ln(P(x)P(p)) because P(x) is proportional to 1/L and P(p) to L. In other words in the pure state there are two kinds of probabilities (p and x) and one must ensure that L disappears. For the two level system there is only one type of probability which contains ei(L) so this L must be offset within the probability itself i.e. by using T. Thus thermodynamical and statistical mechanical behaviours which seem to be present at the pure quantum bound state level have different features for multiple level systems even though the first law of thermodynamics remains the same as does the form of entropy. What seems to change is the role of T temperature. We try to examine these features in this note. In particular we also find that maximization of entropy subject to constant energy which is usually linked to high N scenarios (i.e. factorial calculation in the high N limit) follows from the first law of thermodynamics with dW=0. Thus it holds even for one quantum particle with two energy levels (particle in a box with infinite walls). This, however, makes use of the form E=Sum over i ei P(ei). Such a form does not hold for example for a pure bound state.
Historically, thermodynamics was formulated for macroscopic systems followed by the development of statistical mechanics which provided microscopic formulations for quantities such as entropy. Entropy is traditionally linked to the ln of the number states available or to the Shannon’s form -k Sum over i P(ei) ln(P(ei)) where P(ei) is the probability for the quantity ei. In addition a variable T (linked to average kinetic energy) appears in both theories. Later the Schrodinger equation was developed to describe bound electron states in an atom etc. These states were characterized by a math object W(x) called the wavefunction and a set of discrete energy levels was calculated which matched data of emitted photons. In a previous note (1) we argued that the average energy En for a quantum bound state plays the same role of characterizing equilibrium as T in classical thermodynamics/statistical mechanics. We further argued that En is linked to parameters in the system. For example, for a particle in a box with infinite potential walls, En is linked to L as well as to n the energy level. One may change En by either changing n or L separately (or both). Holding L constant and changing n leads to a certain type of energy change. We argue this is similar to holding the volume of a gas constant and increasing T. Alternatively, one may leave n unchanged (a quantum adiabatic process) and change L i.e. a mechanical change or work. We argue that one may already consider the concept of the first law of thermodynamics at the quantum bound state level i.e. dE = dQ - dWork where Work is linked to a change in a physical parameter, such as L the length of the box, whereas dQ is linked to energy changes not involving a physical parameter e.g. a change in n the energy level. The Schrodinger equation yields solutions for W(x)=Sum over p a(p)exp(ipx) the wavefunction as well as En’s. We have argued in previous notes that W(x) is part of a conditional probability P(p/x)= a(p)exp(ipx)/W(x) and that En is constant at each point x just as T is constant at each x for classical statistical equilibrium (1). Thus a kind of statistical mechanics exists at the wavefunction level we argue. This statistical mechanics makes use of a free particle wavefunction exp(ipx) and weights a(p), but does not contain the usual P(x), P(p) picture of the classical world. We have shown in (2) that one may obtain P(x)=W*(x)W(x) and P(p)=a*(p)a(p) from the conditional probability. The essential physics we argue, however, is at the level of the wavefunction together with its own unique statistical scenario of exp(ipx)’s interacting with exp(ikx)’s from V(x)=Sum over Vkexp(ikx) (see (1)). Given that P(x) and P(p) exist for a quantum bound state, it may be convenient to use them in formulas because they are linked to a classical statistical picture. We argue that one may use P(x) and P(p) to construct an object S such that T dS does not change when one changes L, the size of box with infinite potential walls. We argue that such an object follows from properties of the Schrodinger equation together with various assumptions. We arrive at S=Sp+Sx where Sp=-k Integral dp a(p)a(p) ln{|a(p)a(p)}| and Sx= -k Integral dx W(x)W(x) ln(W(x)W(x)) for a given energy level. We do not use arguments related to taking ln of the number of states present or Shannon’s entropy. Rather we look for a solution which does not depend on L and is additive. We note, however, that for both W(x)W(x) and a(p)a(p) the solution found is mathematically consistent with the entropy form found by considering independent probabilities. This, however, applies to P(x) and P(p), but we argue that the physical situation is based on W(x) and a(p) as solutions of the Schrodinger equation. Nevertheless P(x) and P(p) are physical observables and not simply math constructs and so may think of them in a somewhat classical manner in terms of probability. Thus we argue that thermodynamics is already present at the level of a quantum bound state and that one may obtain Shannon’s entropy at this level using P(x) and P(p), but without considering the overall probability of independent probabilities as in information theory or numbers of states. Rather obtaining a function which is additive in Sp and Sx and eliminates L is the main consideration. We also argue that S=Sp+Sx carries over into mixed quantum state wavefunctions even though it is usually ignored. Thus we try to argue that it is the bound quantum state which gives rise to the notion of thermodynamics and entropy.
Shannon’s entropy: -k Sum over i P(i) ln(P(i)) is expressed in terms of P(i) the probability for state i. If entropy exists as a concept separated from the first law of thermodynamics with dWork=0, then it is not clear what set of states i should be taken in quantum mechanics. In classical statistical mechanics, each particle is automatically described by its position and momentum vectors for no internal motion. For example a pure energy eigenstate wavefunction Wn(x) may be written in terms of many different orthonormal mathematical basis sets e.g. Wn(x)= Sum over i bi phi(i)(x) with probabilities bi*bi. Thus one may create many types of entropy expressions using Shannon’s form without any other physical considerations. For example, W(x)=Sum over p a(p)exp(ipx) and one may create Sp which is usually done in the literature. In previous notes we have argued that Sn = Sp(n)+Sx(n). For a particle in a box with infinite potential walls, Sx(n)=Sx. The sum of the two entropies ensures that the parameter L (box size) vanishes so that a quantum adiabatic transformation is isentropic. Thus a consideration other than Shannon’s form has been used to obtain Sn=Sp(n)+Sx for a particle in a box. Furthermore one may argue Shannon’s form even for a pure state based on S=S1+S2 where 1 and 2 represent two systems. A question still remains: Why are Sx and Sp entropies used and not some other set? Furthermore for a system with several energy levels ei one might ask why -Sum over i P(ei)ln(P(ei)) is used as in (1)? In a previous note (2) we considered that Shannon’s form of entropy follows from dE= TdS (dWork=0) with dE=Sum over i ei dP(ei). Furthermore we argued that P(ei) = C(T)exp(-ei/T) is a solution, but so is C(T) exp(-ei/T) exp(Si) where Si=Sx,i + Sp,i for the pure bound state. In other words, specific states related to the physical situation are chosen and entropy constructed from dE=TdS to reflect this. In this note we argue that entropy may be less related to counting arrangements than to considering the issues involved in energy transfers within a system.
For a classical ideal gas or single particle quantum system with energy levels {ei}, both average energy E=Sum over i ei P(ei/T) and Shannon’s entropy S= - Sum over i P(ei/T) ln(P(ei/T) change (for mechanical parameters kept fixed) in terms of d(P(ei/T)). In fact, in this case ln(P(ei/T)) appears as a “constant vector” in dS i.e. dS= - Sum over i ln(P(ei/T)) dP(ei/T). Both dE (mechanical parameter fixed) and dS change as dP(ei/T), thus there are two vectors {ei/T} and {ln(P(ei/T))} which represent constants over ei’s for a small range of dT where T is temperature. In this case, however, the two vectors are strongly linked as P(ei/T)=exp(-ei/T)/C(T) so ln(P) = -ei/T - ln(C). This is why the relationship E-TS = -T ln(C(T)) exists. For a quantum bound state one may write: e = Integral dp a(p)a(p) pp/2m + Integral dx V(x) W(x)W(x) where W(x)=Sum over p a(p)exp(ipx) is the wavefunction. Instead of having vectors of ei’s, one has two vectors, one over x and the other p (momenta) where a(p)a(p) = P(p) and P(x)=W(x)W(x) (bound states). Thus d e thermal = Integral dp pp/2m dPe(p) + Integral dx V(x) dPe(x) ((1)). In other words de thermal changes linearly in terms of dPe(p) and dPe(x) whereas for a classical ideal gas or many ei system it changes linearly in terms of dP(ei/T). Ei is the variable instead of x and p in that case. In other words {pp/2m} is a constant vector in p space and {V(x)} in x space. Mathematically Shannon’s entropy Sp = - Sum over p Pe(p) ln(Pe(p)) and Sx =- Sum over x Pe(x) ln(Pe(x)) also yield constant vectors in their respective spaces namely ln(Pe(p)) and ln(Pe(x)) which are called information. In particular dSp = - Sum over p ln(Pe(p)) dPe(p) then ln(Pe(p)) behaves like a constant vector within a region of small dPe(p) changes. Note: Sum over p dPe(p)=0. One may consider a set of single valued energy levels ei which are very close (imagine a particle in a box with infinite walls) as a region in which dPe(p) changes (or dPe(x) ones) are very small. In this region, ln(Pe(p)) and ln(Pe(x)), information, represents a constant vector statistically defining the small region of ei states. This we argue is the statistical significance of information ln(P). One may note that both de ((1)) adn dSp and dSx change linearly with dPe(p) and dPe(x), but the vectors {pp/2m} and {V(x)} over p and x space and ln(Pe(p)) and ln(Pe(x)) over the same space are constant vectors, but not equivalent except for the ground state of the quantum oscillator for which they become very similar because Pe(p)=exp(-app) and Pe(x)=exp(-xx/a) with a being proportional to 1/ e which plays the same role as temperature in the classical ideal gas case. For other quantum bound systems, the two sets of vectors are different, but the information vectors seem to give a kind of statistical identity to small regions containing very close ei levels for which dPe(p) and dPe(x) are small. Thus, though one may argue for the presence of ln(P) in Shannon’s entropy S=-Sum over i P(i)ln(P(i)) in many ways, it seems that ln(P(i)) is a constant vector in a certain space i for small dP(i) and gives a statistical identity to that small region.
In this note we wish to examine three ideas. First we consider the case of W(x,t)=Sum over n an exp(-iEn t) Wn(x) ((1)) (for n=0,1 as an example) and note that the von Neuman entropy is 0 for such a state. This is pointed out in (1) together with the fact that there exists a von Neumann density operator exp(-H/T) (H=Hamiltonian operator) which yields the same result as Shannon’s entropy S using P(ei) if one uses dQ/T=Sum over n en dP(en)/T = dS. It seems then that there is a contradiction if the usual von Neumann entropy is 0 yet using a density operator = exp(-H/T) yields nonzero results. A resolution is suggested in (2) which deals with information theory and we see if it applies to ((1)). Secondly, we consider the Shannon’s form P(e)ln(P(e)) in more detail. In Part I and in previous notes we argued that ln ensures that S=S1+S2 if one has two systems. We also argued that dE= Sum over n en dP(en) = TdS if dWork =0. In this note, we argue that a stronger idea may be at work, namely the idea that Eave= Sum over n en P(en/T) and TS are essentially the same function except for a function of T. This approach may be used to show that ln is the function associated with entropy. Finally, we note as in Part I that when using either the von Neumann approach or Shannon’s entropy one must know which probabilities to use. For a system with energy levels en, P(n)=P(en/T) is an immediate candidate, but there may be more probabilities in the system related to a particle jumping from one ei to another. In such a case, if one uses these probabilities and then sums over some of them leaving only P(en/T), the form of entropy changes from that of Shannon’s form. (Originally, however, Shannon’s form is used before summing.)
Addendum Feb. 3, 2022 We restrict S=entropy=Sx+Sp to pure energy eigenstates. I.e. Wn(x) used in Sx is an energy eigenstate. In (1) we suggested the following form for the entropy of a quantum bound state: S = Integral dx W(x)W(x) ln[WW] + Integral dp a(p)a(p) ln[a(p)a(p)] ((1)) where W(x)= Sum over p a(p) exp(ipx). In principle this may be extended to nonpure bound states. In (2) we showed that this definition (which follows from a Shannon’s entropy with a particular choice of probability) ensures that an adiabatic change in the size of box with an infinite potential leads to no change in entropy as ln(1/L) from the first term of ((1)) cancels with ln(L) from the second for every energy level n. This seems to have some thermodynamic consequences. We revisit the particle in a box with infinite potential and also examine the quantum oscillator solution as the spring constant or mass is varied and find that it behaves in a similar way for all energy levels under an adiabatic transformation. We finally consider under what conditions such a transformation would lead to entropy changes.