In (1), Shannon’s spatial entropy is computed using - [W*W] ln[W*W], where W(x) is the wavefunction and a classical envelope approximation: W*(x)W(x)=C/v(x), where v(x) is classical velocity, is used (according to the idea of the correspondence principle). A momentum entropy: - Integral dp a(p)a(p) ln[a(p)a(p)] (one dimension) is also calculated. Recently in (2), we argued that one should form Shannon’s entropy using the probability = a(p1)exp(ip1 x) a(p2)exp(ip2 x). This leads to the following if one sums the first term over p1,p2 and integrates the second over x: Entropy= Integral dx -2W x d/dx W - Integral dp a(p)a(-p) ln[a(p)a(-p)] ((1)) one dimension In (1), the spatial entropy is found to behave as ln(n) for high n whereas for ((2)), spatial entropy is always 1. Thus, there is a very large difference between the two. In (1), a momentum entropy -a(p)a(p)ln[a(p)a(p)] is added to spatial entropy and in ((1)) a very similar momentum piece appears. For the case of the oscillator, W(x) and a(p) are both Gaussians and so the overall result for entropy from (1) and from this note both behave as ln(n) when n is large, but the factor of ln(n) differs. Ours is half as large for the case of a quantum oscillator. For our case, all of the entropy comes from the momentum term in the large n limit. In this note, we consider these ideas in more detail.
In (1), Shannon’s spatial entropy is computed using - [WW] ln[WW], where W(x) is the wavefunction and a classical envelope approximation: W*(x)W(x)=C/v(x), where v(x) is classical velocity, is used (according to the idea of the correspondence principle). A momentum entropy: - Integral dp a(p)a(p) ln[a(p)a(p)] (one dimension) is also calculated. Recently in (2), we argued that one should form Shannon’s entropy using the probability = a(p1)exp(ip1 x) a(p2)exp(ip2 x). This leads to the following if one sums the first term over p1,p2 and integrates the second over x: Entropy= Integral dx -2W x d/dx W - Integral dp a(p)a(-p) ln[a(p)a(-p)] ((1)) one dimension In (1), the spatial entropy is found to behave as ln(n) for high n whereas for ((2)), spatial entropy is always 1. Thus, there is a very large difference between the two. In (1), a momentum entropy -a(p)a(p)ln[a(p)a(p)] is added to spatial entropy and in ((1)) a very similar momentum piece appears. For the case of the oscillator, W(x) and a(p) are both Gaussians and so the overall result for entropy from (1) and from this note both behave as ln(n) when n is large, but the factor of ln(n) differs. Ours is half as large for the case of a quantum oscillator. For our case, all of the entropy comes from the momentum term in the large n limit. In this note, we consider these ideas in more detail.
In the literature, one often finds a quantum expression for Shannon’s entropy of the form: - (W*W) ln(W*W) ((1)) where W*W is spatial density i.e. W(x)= the wavefunction. This implies W*(x)W(x) is an independent probability. Given that W(x)= Sum over p a(p) exp(ipx), and W*W= Sum over p1, p2 a(p1)a(p2) exp(ip1 x) exp(ip2 x), one may see that for p1/-p1 in the latter with a(p)=a(-p) leads to cos(p1x) terms. These are positive and negative in different x regions. In fact, in many cases, the overall spatial density exhibits peaks and valleys suggesting that W*(x)W(x) is correlated, i.e. not independent we argue. Furthermore, the form ((1)) uses only position when there is an expectation value for < p*p> an , both functions of x, where p is momentum. Thus, the variance of p-ensemble average may change with x, yet position only is used in the computation of Shannon’s entropy, which we argue seems unusual. In a previous note (1), we suggest using a(1)exp(ip1 x) a(p2)exp(ip2 x) as the probability for Shannon’s entropy. This leads to a spatial form 2W x d/dx W which matches ((1)) for the ground state of the quantum oscillator case. For the ground state oscillator, W*W=C exp(-ax*x) i.e. a Gaussian. This suggests that for this case only, W*(x)W(x) represents an independent probability which may be used in Shannon’s entropy, we argue. We attempt to consider these issues in this note.
In classical statistical mechanics, C exp[ -( mv*v/2 + V(x))/T) represents density i.e. the probability for a particle to have a velocity v and be at x. If applies this probability to Shannon’s entropy formula, one obtains C/T ( mv*v/2 + V(x)) exp[ -( mv*v/2 + V(x))/T) + exp[ -( mv*v/2 + V(x))/T) ln(C). Thus, it seems energy times density + density times ln(C) is the entropy density, a well known result in classical statistical mechanics, although sometimes not explicitly stated. The first term integrated over x is essentially the kinetic energy, while the second integrated over velocity yields the potential energy term. Thus, the first term partial density seems to be a purely momentum dependent kinetic energy piece times probability and the second a purely x dependent potential energy piece. (There is still an integral over velocity for the first term and one over x for the second to obtain the full entropy.) In quantum mechanics, we argue that a(p1)exp(ip1 x) a(p2) exp(ip2 x) serves as the probability where W(x)=Sum over p a(p) exp(ipx) = wavefunction. This leads to an expression for entropy density with two terms, one of which may be immediately integrated over momentum and the other over space. If one wishes to make a link to the classical statistical mechanical case, one may ask what requirement is necessary for the momentum related piece to represent average kinetic energy and the spatial part, average potential energy. The requirement, we find, yields the wavefunction of the ground state harmonic oscillator. For other cases, the partial density is not equivalent to average energy. Thus, we try to establish a link between entropy density and energy density, but require the kinetic energy related term to be strictly a function of momentum and the potential related term strictly one of x. In quantum mechanics, one may form averages at a point x. For example, KEave(x)= [Sum over p p*p/2m a(p) exp(ipx)]/W(x). If one examines a p/-p pair with a(p)=a(-p) (for example), cos(px) terms arise which are positive at some x and negative at others. We argued in previous notes that this represents stochastic flow in the opposite direction from that expected by -dV/dx. In other words, -dV/dx is an average which consists of stochastic force addends which may give momentum hits to the right or left, but which add to yield -dV/dx. As a result, one may have negative contributions to the kinetic energy (and density as well). In this note, we argue one may also have negative contributions to the entropy density due to this phenomenon.
Linking quantum mechanics to classical mechanics seems to have been an early goal in quantum theory as represented by the correspondence principle. More recently there have been attempts to link the entropy of both a single bound quantum state and a thermal statistical system of quantum states to classical entropies (1),(2). For the former, the entropy is proportional to Integral dx density(x) ln[density(x)] where density(x)= delta t = 1 / v(x) with v(x) being velocity. Thus, density, which is a probability in Shannon’s entropy equation, is a measure of the change in the value of delta t(x) in this classical entropy. Bound state quantum mechanics is said to be time-independent, but by the correspondence principle (1) the probability of the envelope of the wavefunction i.e. Envelope(W(x))* Envelope(W(x)) = delta t(x) so quantum probability (albeit linked to the envelope) is related to classical time intervals which adjust with x to yield the proper ration v(x)=delta x / delta t(x) with delta x being constant. In this note we argue that the expectation value: Integral W(x) d/dx dW/dx = Integral WW KEclassical(x) for a bound state is, in the high energy limit Integral dt KEclassical(x) i.e. a portion of the action, just as in the classical case (i.e. the correspondence principle). This leads to the association of the higher energy limit of the envelope of W times itself with delta t(x).
In the literature (e.g. (1)), the expression - density(x) ln(density(x)) is used as Shannon’s spatial entropy for a quantum system (bound or not). For the bound case, the correspondence principle is said to hold for high energy levels (2). In that case, quantum density = W(x)W(x) (W(x)=real wavefunction) is said to be equivalent to the classical density C/v(x) where v(x) the velocity is given by .5mv(x)v(x) + V(x) = E. Classical density yields a curve which passes through peak regions of quantum density humps. In the classical case, particle motion is completely determinate. C/v(x) as a density (probability) is proportional to dt, the amount of time a particle spends passing through a fixed length dx. If the particle moves quickly, it spends little time, and hence there is less time for a measurement (i.e one may miss the particle due to its speed). We argue in this note that such a scenario does not seem to be in keeping with the ideas of Shannon’s entropy where one has probabilities for certain mutually exclusive events at each ti. For example at each ti, one may toss a coin. If it is not “heads”, this means it is tails. For the classical particle in the correspondence principle, each dx region has its own probability proportional to dt = dx/v(x). Thus, each dx is a region of its own in terms of probability. Thus, if Ci measurements of the presence of the particle are made within dx of xi out of N trials, the probability that a measurement is made in dx at xi is Ci/N and the probability that it is not is 1-Ci/N. Thus, unlike Shannon’s picture, various arrangements do not have the same weight or probability. We investigate this scenario in more detail and argue that it does not follow the approach of Shannon’s entropy. We also try to connect with the quantum situation.
In this note, we examine the behaviour of Shannon’s entropy density for some examples in quantum mechanics. We start with a quasiparticle probability P(x and p) = W(x) fp exp(ipx) (where W(x) is the wavefunction given by Sum over p fp exp(ipx)) and obtain a Shannon’s entropy (after summing on p) : Total entropy density = -P(x) ln(P(x)) - P(p) ln(P(p)) - W(x) x d/dx W(x) ((1)) It may be noted that if f(p)=f(-p) ((1)) may also be written as: Total entropy density = -P(x) ln(P(x)) - P(p) ln(P(p)) - fp p d/dp fp We consider the cases of a particle in a box with an infinite potential at the walls and the harmonic oscillator ground state. Finally we consider the influence of u(x)= [d/dx W(x)]/W(x) on the spatial change of Shannon’s spatial entropy as W(x) and u(x) are often periodic and this leads to a periodic entropy density. In general, entropy is obtained by integrating the entropy density and one may question whether one should examine the density at all. In (1), however, entropy density is considered and it seems that there are some interesting properties of Shannon’s entropy density in quantum systems. Furthermore, there has been some recent work in the literature which makes use of entropy density to create an extra potential term for the Schrodinger equation in cases of temperature.
In the literature, Shannon’s entropy with spatial density as probability i.e. density(x) ln(density(x)) appears frequently. It seems, however, that this calculation of entropy assumes no knowledge of momentum, yet density=W(x)W(x) (for a bound state) where W(x) = Sum over p a(p) exp(ipx). In other words, the wavefunction W(x) contains information about the momentum distribution associated with P(p/x)= a(p) exp(ipx)/W(x). In classical statistical mechanics, entropy is calculated using exp[ - (p*p/2m + V(x))/T) which includes both momentum and spatial considerations. In a previous note (1), we calculated a possible expression for entropy using P(p/x)P(x). This includes Shannon’s spatial entropy and other terms even if one sums over p after forming Shannon’s entropy with P(p/x)P(x). In this note, we try to consider the interpretation of these two forms of entropy.