Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Proceedings of the National Academy of Sciences

INFORMATION CONTENTS OF DISTRIBUTIONS

Eugene Paul Wigner, Mutsuo M. Yanase

Published Jun 1, 1963• 700 citations
Publisher

Abstract

The entropy, as usually defined, is a measure of our ignorance and, if multiplied by — 1, can be considered as a measure of our knowledge of the state of a system.1 It is a measure of our total knowledge into which the knowledge of the value of any observable enters in the same way (cf. section 3). It is this last circumstance which prompted the considerations leading to the present note. According to quantum mechanical theory, some observables can be measured much more easily than others: the observables which commute with the additive conserved quantities (energy, components of the linear and angular momenta, electric charge) can be measured with microscopic apparatuses; those which do not commute with these quantities need for their measurement macroscopic systems.2 Hence, the problem of defining a measure of our knowledge with respect to the latter quantities arises. The present note will be restricted to the case in which there is only one conserved additive quantity; this will be denoted by k. The name “skew information” has been proposed3 for the amount of information which an ensemble described by a state vector or a statistical matrix contains with respect to the not easily measured quantities. This information relates to the transition probabilities into states which lie askew to the characteristic vectors of the additive conserved quantities.

DOI
10.1073/pnas.49.6.910

Related papers

Classical and quantum relative entropy

Patrícia Szokol

The concept of entropy rst arose in the study of thermodynamics and statistical me- chanics. In information theory the so-called Shannon entropy plays a signi cant role, which measures how much information we gain, on average, when we learn the value of a random variable. An alternative interpretation is that the entropy of the random variable quanti es the amount of uncertainty about the random variable before we learn its value. The concept was introduced by Claude E. Shannon in his 1948 paper "A Mathematical Theory of Communication". In the rst part of the present work we consider this fundamental measure of information and show some of its properties, such as non-negativity. The relative entropy or the Kullback-Leibler divergence is a very useful measure of the distance between two prob- ability distributions. After introducing its de nition and other notions (joint entropy, conditional entropy or mutual information) we can prove additional assertions about the Shannon entropy and present statements about the relations between the above men- tioned quantities. In quantum information theory, there is a quantity, namely von Neumann entropy, which corresponds to Shannon entropy and originates from it. In the section Von Neu- mann entropy we will introduce this quantity which is a continuous functional on the states, or on their mathematical representatives, the density operators, and it ful ls in- equalities such as subadditivity and strong subaddititvity. Just as with the Shannon entropy, it is extremely useful to de ne a quantum version of the relative entropy, which is one of the most important numerical quantities appearing in quantum information theory. It is used as a measure of distinguishability between quantum states. Among others its properties are jointly convexity, monotonicity which are speci cally convenient. Transformations on structures which preserve operations, quantities or relations among elements appear in many areas of mathematics. These are the so-called preservers which show up also in physics and even in chemistry where they are usually called symmetries. Therefore, the study of preserver transformations is an important area of research. The third section of this work is based on a paper, in which Lajos Molnár described the structure every bijective map on the space of all density operators on a given Hilbert space, which preserves the relative entropy. This result is closely related to Wigner's famous theorem on the form of quantum mechanical symmetry transformations. The above theorem of Molnár can be extended into two directions. On the one hand, the result holds also in the case when the transformation under consideration acts on the space of all positive semide nite operators not only on density operators (i.e., we omit the condition of unit trace). On the other hand the statement remains valid even if we omit the strongly restrictive condition that the transformation is bijective. The second result is a joint work with Prof. Lajos Molnár which appeared in the journal Linear Algebra and Its Applications.

•May 6, 2010•0 citations

Understanding information in a quantum state

Subhash C. Kak

Information arises out of a communication game played between a sender and receiver of signals. For physical systems, the players may be designated as Nature and the scientist. The average information obtained from a quantum system is given by the von Neumann measurement scheme, which represents a generalization of thermodynamic entropy that is in perfect accord with common sense when considering a mixed state. While testing multiple copies of such a state can reveal information about the choice made by the sender, entropy for an unknown pure state is zero. A related puzzle is how the total information in the universe appears to be increasing over time.1 Zero entropy for an unknown pure state is reasonable inasmuch as once that state has been identified, no further information may be gained from examining its copies. But such an idea will not be reasonable if the game between sender and receiver consists of the former choosing one of a certain number of polarization states (say, for a photon) and supplying several copies to the receiver. In this case, measurements made on the copies reveal information regarding the sender’s choices. If the set of choices is infinite, the ‘information’ generated by the source is unbounded. From the point of view of the preparer of the states, information in the pure state is limited by the ‘relationship’ between source and receiver, and by the precision of the receiver’s measurement apparatus. If the sender chose a polarization state with which the apparatus was synchronized, the receiver could readily recognize the state. In recent papers,2, 3 I have been investigating information obtainable from an unknown pure state within the framework of communication between source and receiver. I propose a measure of entropy that covers both pure and mixed states. In general, entropy has two components. One is informational, related to the pure components of the quantum state, which can vary by receiver. The other component is thermodynamic and independent of the receiver. The increase of information over time is a consequence of the interplay between unitary and non-unitary evolution, which makes it possible to transform one type of information into the other. Such complementarity indicates that a fundamental duality is essential for information. For a two-component elementary mixed state, the most information to be obtained from each measurement is one bit. Each further measurement of identically prepared states will also yield one bit. For an unknown pure state, information represents the choice made by the source from an infinity of choices related to the values of probability amplitudes with respect to the basis components of the receiver’s measurement apparatus. For a two-component pure state, each measurement also provides a maximum of one bit of information. If the source has made available an unlimited number of identically prepared states, the receiver can obtain additional information from each measurement until the probability amplitudes have been correctly estimated. Once that has occurred, unlike the case with a mixed state, no further information will be obtained from testing additional copies of this pure state. These ideas have potential application in the field of quantum computing. Estimates by the receiver can be made by adjusting the basis vectors to move closer to the unknown pure state. In the most general case, the information obtainable from such a state in repeated experiments is potentially infinite. But if the observer learns the value of the pure state, the information associated with the states vanishes. This suggests a fundamental divide between objective and subjective information. This approach is consistent with the positivist view that one cannot speak of information associated with a system except in relation to an experimental arrangement together with the protocol for measurement. The experimental arrangement is thus integral to the amount of information that can be obtained. The informational measure I have proposed resolves the puzzle of entropy increase. We can suppose that, in the begin-

SPIE Newsroom•Jan 1, 2007•0 citations

Wigner-Yanase Skew Information and Uncertainty Relations

Shunlong Luo

The Wigner-Araki-Yanase theorem puts a limitation on the measurement of observables in the presence of a conserved quantity, and the notion of Wigner-Yanase skew information quantifies the amount of information on the values of observables not commuting with the conserved quantity. We demonstrate that the statistical idea underlying the skew information is the Fisher information in the theory of statistical estimation. A quantum Cramér-Rao inequality and a new uncertainty relation in terms of the skew information are established, which shed considerable new light on the relationships between quantum measurement and statistical inference. The result is applied to estimating the evolution speed of quantum states.

Physical Review Letters•Oct 29, 2003•378 citations

INFORMATION AND ENTROPY: THE QUANTUM VIEW

This chapter provides a quantum leap from the notions introduced in Chapter 2. Specifically, quantum information will be related to the uncertainty in knowing the state of a system, and to characterize it, quantum entropies will be introduced.

WORLD SCIENTIFIC eBooks•Apr 20, 2020•0 citations

Quantum state reconstruction and optimal manipulations with quantum information (1996 IOC Prize Winner)

Vladimír Bužek

The concept of a quantum state represents one of the most fundamental pillars of the paradigm of quantum theory.'3 Contrary to its mathematical elegance and convenience in calculations, the physical interpretation of a quantum state is not so transparent. The problem is that the quantum state (described either by a state vector, or density operator or a phase-space probability density distribution) does not have a well defined objective status, i.e. a state vector is not an objective property of a particle. According to Peres (see,1 p. 374): "There is no physical evidence whatsoever that every physical system has at every instant a well defined state. .. In strict interpretation of quantum theory these mathematical symbols [i.e., state vectorsi represent statistical information enabling us to compute the probabilities of occurrence of specific events." Once this point of view is adopted then it becomes clear that any "measurement" or a reconstruction of a density operator (or its mathematical equivalent) can be understood exclusively as an expression of our knowledge about the quantum mechanical state based on a certain set of measured data. To be more specific, any quantum-mechanical reconstruction scheme is nothing more than an a posteriori estimation of the density operator of a quantum-mechanical (microscopic) system based on data obtained with the help of a macroscopic measurement apparatus.3 The quality of the reconstruction depends on the "quality" of the measured data and the efficiency of the reconstruction procedure with the help of which the data analysis is performed. In particular, we can specify three different situations. Firstly, when all system observables are precisely measured. In this case the complete reconstruction of an initially unknown state can be performed (we will call this the reconstruction on the complete observation level) . Secondly, when just part of the system observables is precisely measured then one cannot perform a complete reconstruction of the measured state. Nevertheless, the reconstructed density operator still uniquely determines mean values of the measured observables (we will denote this scheme as reconstruction on incomplete observation levels) . Finally, when measurement does not provide us with sufficient information to specify the exact mean values (or probability distributions) but only the frequencies of appearances of eigenstates of the measured observables, then one can perform an estimation (e.g. reconstruction based on quantum Bayesian inference) which is the "best" with respect to the given measured data and the a priori knowledge about the state of the measured system.

Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE•Jul 19, 1999•0 citations

Information and quantum measurements

Carlton M. Caves

Statistical entropy measures the information one does not have about a physical system.

Annual Meeting Optical Society of America•Jan 1, 1993•2 citations
The entropy, as usually defined, is a measure of our ignorance and, if multiplied by — 1, can be considered as a measure of our knowledge of the state of a system.1 It is a measure of our total knowledge into which the knowledge of the value of any observable enters in the same way (cf. section 3). It is this last circumstance which prompted the considerations leading to the present note. According to quantum mechanical theory, some observables can be measured much more easily than others: the observables which commute with the additive conserved quantities (energy, components of the linear and angular momenta, electric charge) can be measured with microscopic apparatuses; those which do not commute with these quantities need for their measurement macroscopic systems.2 Hence, the problem of defining a measure of our knowledge with respect to the latter quantities arises. The present note will be restricted to the case in which there is only one conserved additive quantity; this will be denoted by k. The name “skew information” has been proposed3 for the amount of information which an ensemble described by a state vector or a statistical matrix contains with respect to the not easily measured quantities. This information relates to the transition probabilities into states which lie askew to the characteristic vectors of the additive conserved quantities.
The concept of entropy rst arose in the study of thermodynamics and statistical me- chanics. In information theory the so-called Shannon entropy plays a signi cant role, which measures how much information we gain, on average, when we learn the value of a random variable. An alternative interpretation is that the entropy of the random variable quanti es the amount of uncertainty about the random variable before we learn its value. The concept was introduced by Claude E. Shannon in his 1948 paper "A Mathematical Theory of Communication". In the rst part of the present work we consider this fundamental measure of information and show some of its properties, such as non-negativity. The relative entropy or the Kullback-Leibler divergence is a very useful measure of the distance between two prob- ability distributions. After introducing its de nition and other notions (joint entropy, conditional entropy or mutual information) we can prove additional assertions about the Shannon entropy and present statements about the relations between the above men- tioned quantities. In quantum information theory, there is a quantity, namely von Neumann entropy, which corresponds to Shannon entropy and originates from it. In the section Von Neu- mann entropy we will introduce this quantity which is a continuous functional on the states, or on their mathematical representatives, the density operators, and it ful ls in- equalities such as subadditivity and strong subaddititvity. Just as with the Shannon entropy, it is extremely useful to de ne a quantum version of the relative entropy, which is one of the most important numerical quantities appearing in quantum information theory. It is used as a measure of distinguishability between quantum states. Among others its properties are jointly convexity, monotonicity which are speci cally convenient. Transformations on structures which preserve operations, quantities or relations among elements appear in many areas of mathematics. These are the so-called preservers which show up also in physics and even in chemistry where they are usually called symmetries. Therefore, the study of preserver transformations is an important area of research. The third section of this work is based on a paper, in which Lajos Molnár described the structure every bijective map on the space of all density operators on a given Hilbert space, which preserves the relative entropy. This result is closely related to Wigner's famous theorem on the form of quantum mechanical symmetry transformations. The above theorem of Molnár can be extended into two directions. On the one hand, the result holds also in the case when the transformation under consideration acts on the space of all positive semide nite operators not only on density operators (i.e., we omit the condition of unit trace). On the other hand the statement remains valid even if we omit the strongly restrictive condition that the transformation is bijective. The second result is a joint work with Prof. Lajos Molnár which appeared in the journal Linear Algebra and Its Applications.
Information arises out of a communication game played between a sender and receiver of signals. For physical systems, the players may be designated as Nature and the scientist. The average information obtained from a quantum system is given by the von Neumann measurement scheme, which represents a generalization of thermodynamic entropy that is in perfect accord with common sense when considering a mixed state. While testing multiple copies of such a state can reveal information about the choice made by the sender, entropy for an unknown pure state is zero. A related puzzle is how the total information in the universe appears to be increasing over time.1 Zero entropy for an unknown pure state is reasonable inasmuch as once that state has been identified, no further information may be gained from examining its copies. But such an idea will not be reasonable if the game between sender and receiver consists of the former choosing one of a certain number of polarization states (say, for a photon) and supplying several copies to the receiver. In this case, measurements made on the copies reveal information regarding the sender’s choices. If the set of choices is infinite, the ‘information’ generated by the source is unbounded. From the point of view of the preparer of the states, information in the pure state is limited by the ‘relationship’ between source and receiver, and by the precision of the receiver’s measurement apparatus. If the sender chose a polarization state with which the apparatus was synchronized, the receiver could readily recognize the state. In recent papers,2, 3 I have been investigating information obtainable from an unknown pure state within the framework of communication between source and receiver. I propose a measure of entropy that covers both pure and mixed states. In general, entropy has two components. One is informational, related to the pure components of the quantum state, which can vary by receiver. The other component is thermodynamic and independent of the receiver. The increase of information over time is a consequence of the interplay between unitary and non-unitary evolution, which makes it possible to transform one type of information into the other. Such complementarity indicates that a fundamental duality is essential for information. For a two-component elementary mixed state, the most information to be obtained from each measurement is one bit. Each further measurement of identically prepared states will also yield one bit. For an unknown pure state, information represents the choice made by the source from an infinity of choices related to the values of probability amplitudes with respect to the basis components of the receiver’s measurement apparatus. For a two-component pure state, each measurement also provides a maximum of one bit of information. If the source has made available an unlimited number of identically prepared states, the receiver can obtain additional information from each measurement until the probability amplitudes have been correctly estimated. Once that has occurred, unlike the case with a mixed state, no further information will be obtained from testing additional copies of this pure state. These ideas have potential application in the field of quantum computing. Estimates by the receiver can be made by adjusting the basis vectors to move closer to the unknown pure state. In the most general case, the information obtainable from such a state in repeated experiments is potentially infinite. But if the observer learns the value of the pure state, the information associated with the states vanishes. This suggests a fundamental divide between objective and subjective information. This approach is consistent with the positivist view that one cannot speak of information associated with a system except in relation to an experimental arrangement together with the protocol for measurement. The experimental arrangement is thus integral to the amount of information that can be obtained. The informational measure I have proposed resolves the puzzle of entropy increase. We can suppose that, in the begin-
The Wigner-Araki-Yanase theorem puts a limitation on the measurement of observables in the presence of a conserved quantity, and the notion of Wigner-Yanase skew information quantifies the amount of information on the values of observables not commuting with the conserved quantity. We demonstrate that the statistical idea underlying the skew information is the Fisher information in the theory of statistical estimation. A quantum Cramér-Rao inequality and a new uncertainty relation in terms of the skew information are established, which shed considerable new light on the relationships between quantum measurement and statistical inference. The result is applied to estimating the evolution speed of quantum states.
The concept of a quantum state represents one of the most fundamental pillars of the paradigm of quantum theory.'3 Contrary to its mathematical elegance and convenience in calculations, the physical interpretation of a quantum state is not so transparent. The problem is that the quantum state (described either by a state vector, or density operator or a phase-space probability density distribution) does not have a well defined objective status, i.e. a state vector is not an objective property of a particle. According to Peres (see,1 p. 374): "There is no physical evidence whatsoever that every physical system has at every instant a well defined state. .. In strict interpretation of quantum theory these mathematical symbols [i.e., state vectorsi represent statistical information enabling us to compute the probabilities of occurrence of specific events." Once this point of view is adopted then it becomes clear that any "measurement" or a reconstruction of a density operator (or its mathematical equivalent) can be understood exclusively as an expression of our knowledge about the quantum mechanical state based on a certain set of measured data. To be more specific, any quantum-mechanical reconstruction scheme is nothing more than an a posteriori estimation of the density operator of a quantum-mechanical (microscopic) system based on data obtained with the help of a macroscopic measurement apparatus.3 The quality of the reconstruction depends on the "quality" of the measured data and the efficiency of the reconstruction procedure with the help of which the data analysis is performed. In particular, we can specify three different situations. Firstly, when all system observables are precisely measured. In this case the complete reconstruction of an initially unknown state can be performed (we will call this the reconstruction on the complete observation level) . Secondly, when just part of the system observables is precisely measured then one cannot perform a complete reconstruction of the measured state. Nevertheless, the reconstructed density operator still uniquely determines mean values of the measured observables (we will denote this scheme as reconstruction on incomplete observation levels) . Finally, when measurement does not provide us with sufficient information to specify the exact mean values (or probability distributions) but only the frequencies of appearances of eigenstates of the measured observables, then one can perform an estimation (e.g. reconstruction based on quantum Bayesian inference) which is the "best" with respect to the given measured data and the a priori knowledge about the state of the measured system.