Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1411.3136

Shannon Entropy and Many-Electron Correlations: Theoretical Concepts, Numerical Results and Collins Conjecture

Luigi Delle Site

Published Nov 12, 2014• 0 citations
arXivHTMLPDF

Abstract

In this paper I will discuss the overlap between the concept of Shannon Entropy and the concept of electronic correlation. Quantum Monte Carlo numerical results for the uniform electron gas are also presented; these latter on the one hand enhance the hypothesis of a direct link between the two concepts but on the other hand leave a series of open questions which may be employed to trace a roadmap for the future research in the field.

DOI
10.48550/arxiv.1411.3136

Related papers

Shannon entropy and many‐electron correlations: Theoretical concepts, numerical results, and Collins conjecture

Luigi Delle Site

In this article, I will discuss the overlap between the concept of Shannon entropy and the concept of electronic correlation. Quantum Monte Carlo numerical results for the uniform electron gas are also presented; these latter on the one hand enhance the hypothesis of a direct link between the two concepts but on the other hand leave a series of open questions which may be used to trace a roadmap for the future research in the field. © 2014 Wiley Periodicals, Inc.

International Journal of Quantum Chemistry•Nov 28, 2014•59 citations

On the scaling properties of the correlation term of the electron kinetic functional and its relation to the Shannon measure

Luigi Delle Site

In a previous work (Ghiringhelli L. M. and Delle Site L., Phys. Rev. B , 77 (2008) 073104) we have proposed a methodological approach to determine the electron correlations contained in the kinetic functional. Its application to the test case of an almost uniform interacting electron gas led to a local density functional of the form ∫ρ( r )lnρ( r )d r . In this work we discuss the interpretation of such a result by performing an analysis of the formal and numerical properties of the functional under the process of coordinates' scaling. On the basis of such an analysis we propose a local analytic form of the kinetic functional of which the previous numerical result is a first-order approximation.

Europhysics Letters (EPL)•May 1, 2009•21 citations

FISHER-SHANNON ENTROPIC UNCERTAINTY RELATIONS AND THEIR POWER-PRODUCTS AS A MEASURE OF ELECTRONIC CORRELATION

Sudin Singh, Aparna Saha

In this paper, we have presented an analytical model of two electron systems consisting of a many particle correlated wave function with some variational parameters α, λ and µ and used it to quantify the electron-electron correlation described by the wave function containing explicitly r12 (inter atomic distance between two electrons) dependent term. The single particle wave functions and the charge densities have been extracted from the said correlated wave function both for the uncorrelated and correlated systems in coordinate space and its momentum analogs have been obtained by taking the Fourier transform of the coordinate analogs. We have computed and presented the results of the numerical values of the theoretic information entropies of the Shannon entropy, Fisher information entropy, Shannon power and the FisherShannon product. The numerical values are consistently found to satisfy the Beckner, Bialynicki-Birula and Mycielski (BBM ) inequality relation; Stam-Cramer-Rao inequalities or Fisher based uncertainty relation and Fisher-Shannon product relation for the uncorrelated and correlated systems in both the coordinate and momentum spaces.

jnanabha•Jan 1, 2023•0 citations

Shannon and Rényi entropies of molecular densities: insights into extensivity and the incomplete description of electron correlation

Diogo J. L. Rodrigues, Evelio Francisco, Ángel Martín Pendás

In this work, we investigate the reliability of information-theoretic measures based on the electron-density and shape-function, specifically Shannon and Rényi entropies, as descriptors of electronic correlation. By establishing a rigorous decomposition of these entropic measures into additive and nonadditive contributions, supported on a Mulliken-like atomic partition of molecules, we systematically analyze the asymptotic behavior of the entropies at the infinite-internuclear-distance limit to assess the problem of static correlation and extensivity. Our algebraic and numerical analysis reveals several flaws in the use of these density-based descriptors. We demonstrate that for minimal-basis and different theoretical levels, the Shannon and Rényi entropies fail to encode the amount of static correlation conveyed by the underlying wavefunction. Conversely, shape-function Shannon entropies and Rényi entropies (for $α\neq 1$) violate extensivity. In larger basis sets, uncorrelated Hartree-Fock densities consistently overestimate entropy compared to sufficiently correlated (e.g., full-valence-CAS) densities. Moreover, the entropies for insufficiently correlated methods violate extensivity. These findings indicate that electron-density-based measures are insufficient for capturing static correlation, suggesting that robust entropic descriptors should be constructed from higher-dimensional Hilbert-space objects.

quant-pharXiv:2604.18081•Apr 21, 2026

Quantum information: Jaynes and Shannon entropies in a two-electron entangled artificial atom

C. Amovilli, Norman Henry March

In the context of quantum information, both Shannon entropy and the different Jaynes entropy for a two-electron ``entangled artificial'' atom proposed by Moshinsky are studied here. The Jaynes entropy in this model is shown to be intimately related to the correlation kinetic energy. A generalization of the customary Shannon entropy based on the electron density is then proposed in terms of the electron pair correlation function. Both definitions behave in a similar way to the Jaynes entropy when considered as a function of the strength of the model electron-electron interaction.

Physical Review A•May 12, 2004•91 citations

Dependence of information entropy of uniform Fermi systems on correlations and thermal effects

Ch. C. Moustakidis, S. E. Massen

The influence of correlations of uniform Fermi systems (nuclear matter, electron gas, and liquid $^{3}\mathrm{He}$) on Shannon's information entropy, $S$, is studied. $S$ is the sum of the information entropies in position and momentum spaces. It is found that, for three different Fermi systems with different particle interactions, the correlated part of $S$ $({S}_{\mathit{cor}})$ depends on the correlation parameter of the systems or on the discontinuity gap of the momentum distribution through two parameter expressions. The values of the parameters characterize the strength of the correlations. A two parameter expression also holds between ${S}_{\mathit{cor}}$ and the mean kinetic energy $(K)$ of the Fermi system. The study of thermal effects on the uncorrelated electron gas leads to a relation between the thermal part of $S$ $({S}_{\mathit{\text{thermal}}})$ and the fundamental quantities of temperature, thermodynamical entropy, and the mean kinetic energy. It is found that, in the case of low temperature limit, the expression connecting ${S}_{\mathit{\text{thermal}}}$ with $K$ is the same to the one which connects ${S}_{\mathit{cor}}$ with $K$. There are only some small differences on the values of the parameters. Thus, regardless of the reason (correlations or thermal) that changes $K$, $S$ takes almost the same value.

arXiv:cond-mat/0404330•Physical Review B•Jan 4, 2005•26 citations
In this paper I will discuss the overlap between the concept of Shannon Entropy and the concept of electronic correlation. Quantum Monte Carlo numerical results for the uniform electron gas are also presented; these latter on the one hand enhance the hypothesis of a direct link between the two concepts but on the other hand leave a series of open questions which may be employed to trace a roadmap for the future research in the field.
In a previous work (Ghiringhelli L. M. and Delle Site L., Phys. Rev. B , 77 (2008) 073104) we have proposed a methodological approach to determine the electron correlations contained in the kinetic functional. Its application to the test case of an almost uniform interacting electron gas led to a local density functional of the form ∫ρ( r )lnρ( r )d r . In this work we discuss the interpretation of such a result by performing an analysis of the formal and numerical properties of the functional under the process of coordinates' scaling. On the basis of such an analysis we propose a local analytic form of the kinetic functional of which the previous numerical result is a first-order approximation.
In this paper, we have presented an analytical model of two electron systems consisting of a many particle correlated wave function with some variational parameters α, λ and µ and used it to quantify the electron-electron correlation described by the wave function containing explicitly r12 (inter atomic distance between two electrons) dependent term. The single particle wave functions and the charge densities have been extracted from the said correlated wave function both for the uncorrelated and correlated systems in coordinate space and its momentum analogs have been obtained by taking the Fourier transform of the coordinate analogs. We have computed and presented the results of the numerical values of the theoretic information entropies of the Shannon entropy, Fisher information entropy, Shannon power and the FisherShannon product. The numerical values are consistently found to satisfy the Beckner, Bialynicki-Birula and Mycielski (BBM ) inequality relation; Stam-Cramer-Rao inequalities or Fisher based uncertainty relation and Fisher-Shannon product relation for the uncorrelated and correlated systems in both the coordinate and momentum spaces.
In this work, we investigate the reliability of information-theoretic measures based on the electron-density and shape-function, specifically Shannon and Rényi entropies, as descriptors of electronic correlation. By establishing a rigorous decomposition of these entropic measures into additive and nonadditive contributions, supported on a Mulliken-like atomic partition of molecules, we systematically analyze the asymptotic behavior of the entropies at the infinite-internuclear-distance limit to assess the problem of static correlation and extensivity. Our algebraic and numerical analysis reveals several flaws in the use of these density-based descriptors. We demonstrate that for minimal-basis and different theoretical levels, the Shannon and Rényi entropies fail to encode the amount of static correlation conveyed by the underlying wavefunction. Conversely, shape-function Shannon entropies and Rényi entropies (for α≠1α\neq 1α=1) violate extensivity. In larger basis sets, uncorrelated Hartree-Fock densities consistently overestimate entropy compared to sufficiently correlated (e.g., full-valence-CAS) densities. Moreover, the entropies for insufficiently correlated methods violate extensivity. These findings indicate that electron-density-based measures are insufficient for capturing static correlation, suggesting that robust entropic descriptors should be constructed from higher-dimensional Hilbert-space objects.
In the context of quantum information, both Shannon entropy and the different Jaynes entropy for a two-electron ``entangled artificial'' atom proposed by Moshinsky are studied here. The Jaynes entropy in this model is shown to be intimately related to the correlation kinetic energy. A generalization of the customary Shannon entropy based on the electron density is then proposed in terms of the electron pair correlation function. Both definitions behave in a similar way to the Jaynes entropy when considered as a function of the strength of the model electron-electron interaction.
The influence of correlations of uniform Fermi systems (nuclear matter, electron gas, and liquid 3He^{3}\mathrm{He}3He) on Shannon's information entropy, SSS, is studied. SSS is the sum of the information entropies in position and momentum spaces. It is found that, for three different Fermi systems with different particle interactions, the correlated part of SSS (Scor)({S}_{\mathit{cor}})(Scor​) depends on the correlation parameter of the systems or on the discontinuity gap of the momentum distribution through two parameter expressions. The values of the parameters characterize the strength of the correlations. A two parameter expression also holds between Scor{S}_{\mathit{cor}}Scor​ and the mean kinetic energy (K)(K)(K) of the Fermi system. The study of thermal effects on the uncorrelated electron gas leads to a relation between the thermal part of SSS (Sthermal)({S}_{\mathit{\text{thermal}}})(Sthermal​) and the fundamental quantities of temperature, thermodynamical entropy, and the mean kinetic energy. It is found that, in the case of low temperature limit, the expression connecting Sthermal{S}_{\mathit{\text{thermal}}}Sthermal​ with KKK is the same to the one which connects Scor{S}_{\mathit{cor}}Scor​ with KKK. There are only some small differences on the values of the parameters. Thus, regardless of the reason (correlations or thermal) that changes KKK, SSS takes almost the same value.