arXiv:quant-ph/0007116

Comment on "Conceptual Inadequacy of Shannon Information ..." by C. Brukner and A. Zeilinger

Michael J. W. Hall

Published Jul 31, 2000• 8 citations

Abstract

It is pointed out that the case for Shannon entropy and von Neumann entropy, as measures of uncertainty in quantum mechanics, is not as bleak as suggested in quant-ph/0006087. The main argument of the latter is based on one particular interpretation of Shannon's H-function (related to consecutive measurements), and is shown explicitly to fail for other physical interpretations. Further, it is shown that Shannon and von Neumann entropies have in fact a common fundamental significance, connected to the existence of a unique geometric measure of uncertainty for classical and quantum ensembles. Some new properties of the ``total information'' measure proposed in quant-ph/0006087 are also given.

DOI: 10.48550/arxiv.quant-ph/0007116

Related papers

On the Supposed Conceptual Inadequacy of the Shannon Information

Christopher G. Timpson

In Phys. Rev. A 63 022113 (2001), Brukner and Zeilinger claim that the Shannon information is not well defined as a measure of information in quantum mechanics, adducing arguments that seek to show that it is inextricably tied to classical notions of measurement. It is shown here that these arguments do not succeed: the Shannon information does not have problematic ties to classical concepts. In a further argument, Brukner and Zeilinger compare the Shannon information unfavourably to their preferred information measure, I(p), with regard to the definition of a notion of `total information content'. This argument is found unconvincing and the relationship betwen measures of information and notions of `total information content' investigated.

Dec 30, 20018 citations

The information entropy of quantum-mechanical states

A Stotland, A. A Pomeransky, E Bachmat +1 more

It is well known that a Shannon-based definition of information entropy leads in the classical case to the Boltzmann entropy. It is tempting to regard the von Neumann entropy as the corresponding quantum-mechanical definition. But the latter is problematic from the quantum information point of view. Consequently, we introduce a new definition of entropy that reflects the inherent uncertainty of quantum-mechanical states. We derive for it an explicit expression, and discuss some of its general properties. We distinguish between the minimum uncertainty entropy of pure states, and the excess statistical entropy of mixtures.

arXiv:quant-ph/0401021Europhysics Letters (EPL)Aug 25, 200411 citations

The Applicability of Shannon Information in Quantum Mechanics and Zeilinger's Foundational Principle

Christopher G. Timpson

Recently, Brukner and Zeilinger have presented a number of arguments suggesting that the Shannon information is not well defined as a measure of information in quantum mechanics. If established, this result would be highly significant, as the Shannon information is fundamental to the way we think about information not only in classical but also in quantum information theory. On consideration, however, these arguments are found unsuccessful; I go on to suggest how they might be arising as a consequence of Zeilinger's proposed foundational principle for quantum mechanics.

Philosophy of ScienceDec 1, 200311 citations

The information entropy of quantum mechanical states

Alexander Stotland, A. A. Pomeransky, Eitan Bachmat +1 more

It is well known that a Shannon based definition of information entropy leads in the classical case to the Boltzmann definition of entropy. It is tempting to regard the Von Neumann entropy as the corresponding quantum mechanical definition. But the latter has little to do with information theory. Consequently we introduce a new definition of entropy that reflects the inherent uncertainty of quantum mechanical states. We derive for it an explicit expression, and discuss some of its general properties. We distinguish between the minimum uncertainty entropy of pure states, and the excess statistical entropy of mixtures.

Jan 1, 200414 citations

Entanglement as a More Fundamental Notion of Information than Shannon and von Neumann Entropy

Michael W Barry

Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression properties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement—the pattern of non-classical correlations between systems—is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies assign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical “truth” emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.

Dec 27, 20250 citations

Entropy in Quantum Probability I

Dėnes Petz

The notion of entropy was introduced by Clausius in order to discuss the thermal behavior of physical systems. After the work of Clausius, Boltzmann, Gibbs and others, the beginning of the exact treatment of entropy was due to von Neumann and Shannon. Their starting point was very di erent, von Neumann was motivated by quantum mechanics and Shannon founded communication theory. The entropy of a state describing a physical system is a quantity expressing the uncertainty or randomness of the system. Shannon regarded this uncertainty attached to a physical system as the amount of information carried by the system, so that the entropy of a state can be read as the information carried by the state. His idea comes from the following consideration: If a physical system has a large uncertainty and one receives information on the system by some procedure, then the so obtained information is more valuable than that received from a system having less uncertainty. It is understood in probability theory that the notion of (Shannon or measure theoretic) entropy has successful applications in a variety of subjects because it determines the asymptotic behavior of certain probabilities in the course of independent trials. First we will discuss this phenomena for nite quantum systems. By a nite quantum system we mean an algebra of matrices which is stable under taking adjoint. (In other words, a nite quantum system is a nite dimensional C*algebra.) If A is such an algebra then there is a linear functional Tr which takes the value 1 at each minimal projection. It is "tracial " in the sense that Tr ab = Tr ba (a; b 2 A) Every functional! on A is determined by a density operator D! 2 A in the form!(a) = Tr D! a (a 2 A): The entropy S(!) of a functional! is de ned by means of its density operator as S(!) = Tr (D!): This notion was introduced by von Neumann in 1927 and we term it von Neumann's entropy or shortly entropy (cf. [1]). In fact, von Neumann de ned the entropy such

QP-PQ, quantum probability and white noise analysisJul 1, 19922 citations