Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Shannon Entropy: From Probabilities to Particles

Thomas Wallek, Andreas Pfennig

Published Feb 13, 2012• 0 citations
OpenAlex

Related papers

Physical information entropy and probability Shannon entropy

Renato Ascoli, R. Urigu

International Journal of Theoretical Physics•Aug 1, 1997•0 citations

Introduction to Logical Entropy and its Relationship to Shannon Entropy

David Ellerman

•Jan 1, 2021•8 citations

Shannon's Entropy and the Correspondence Principle

Francesco R. Ruggeri

In the literature (e.g. (1)), the expression - density(x) ln(density(x)) is used as Shannon’s spatial entropy for a quantum system (bound or not). For the bound case, the correspondence principle is said to hold for high energy levels (2). In that case, quantum density = W(x)W(x) (W(x)=real wavefunction) is said to be equivalent to the classical density C/v(x) where v(x) the velocity is given by .5mv(x)v(x) + V(x) = E. Classical density yields a curve which passes through peak regions of quantum density humps. In the classical case, particle motion is completely determinate. C/v(x) as a density (probability) is proportional to dt, the amount of time a particle spends passing through a fixed length dx. If the particle moves quickly, it spends little time, and hence there is less time for a measurement (i.e one may miss the particle due to its speed). We argue in this note that such a scenario does not seem to be in keeping with the ideas of Shannon’s entropy where one has probabilities for certain mutually exclusive events at each ti. For example at each ti, one may toss a coin. If it is not “heads”, this means it is tails. For the classical particle in the correspondence principle, each dx region has its own probability proportional to dt = dx/v(x). Thus, each dx is a region of its own in terms of probability. Thus, if Ci measurements of the presence of the particle are made within dx of xi out of N trials, the probability that a measurement is made in dx at xi is Ci/N and the probability that it is not is 1-Ci/N. Thus, unlike Shannon’s picture, various arrangements do not have the same weight or probability. We investigate this scenario in more detail and argue that it does not follow the approach of Shannon’s entropy. We also try to connect with the quantum situation.

•Oct 16, 2020•0 citations

Information Theory and Statistical Entropy

Roger Balian

Springer eBooks•Jan 1, 1991•2 citations

Shannon and Renyi Entropy of Wavelets

H. M. de Oliveira

This paper reports a new reading for wavelets, which is based on the classical 'De Broglie' principle. The wave-particle duality principle is adapted to wavelets. Every continuous basic wavelet is associated with a proper probability density, allowing defining the Shannon entropy of a wavelet. Further entropy definitions are considered, such as Jumarie or Renyi entropy of wavelets. We proved that any wavelet of the same family has the same Shannon entropy of its mother wavelet. Finally, the Shannon entropy for a few standard wavelet families is determined.

arXiv:1502.01871•Feb 6, 2015•3 citations

Statistical Complexity and Fisher-Shannon Information: Applications

Ricardo López‐Ruiz, Jaime Sañudo A, E. Romera +1 more

arXiv:1201.2291•Springer eBooks•Jan 1, 2011•20 citations
In the literature (e.g. (1)), the expression - density(x) ln(density(x)) is used as Shannon’s spatial entropy for a quantum system (bound or not). For the bound case, the correspondence principle is said to hold for high energy levels (2). In that case, quantum density = W(x)W(x) (W(x)=real wavefunction) is said to be equivalent to the classical density C/v(x) where v(x) the velocity is given by .5mv(x)v(x) + V(x) = E. Classical density yields a curve which passes through peak regions of quantum density humps. In the classical case, particle motion is completely determinate. C/v(x) as a density (probability) is proportional to dt, the amount of time a particle spends passing through a fixed length dx. If the particle moves quickly, it spends little time, and hence there is less time for a measurement (i.e one may miss the particle due to its speed). We argue in this note that such a scenario does not seem to be in keeping with the ideas of Shannon’s entropy where one has probabilities for certain mutually exclusive events at each ti. For example at each ti, one may toss a coin. If it is not “heads”, this means it is tails. For the classical particle in the correspondence principle, each dx region has its own probability proportional to dt = dx/v(x). Thus, each dx is a region of its own in terms of probability. Thus, if Ci measurements of the presence of the particle are made within dx of xi out of N trials, the probability that a measurement is made in dx at xi is Ci/N and the probability that it is not is 1-Ci/N. Thus, unlike Shannon’s picture, various arrangements do not have the same weight or probability. We investigate this scenario in more detail and argue that it does not follow the approach of Shannon’s entropy. We also try to connect with the quantum situation.
This paper reports a new reading for wavelets, which is based on the classical 'De Broglie' principle. The wave-particle duality principle is adapted to wavelets. Every continuous basic wavelet is associated with a proper probability density, allowing defining the Shannon entropy of a wavelet. Further entropy definitions are considered, such as Jumarie or Renyi entropy of wavelets. We proved that any wavelet of the same family has the same Shannon entropy of its mother wavelet. Finally, the Shannon entropy for a few standard wavelet families is determined.