The concept of information (by Shannon) is generalized for quantum statistical ensembles, and the consistent quantum-theoretical form of the entropy defect principle is obtained. The efect of the irreversiblility of quantummechanical measurements on information transmission is analyzed. For the ensemble of two pure quantum states, the optimal measurement procedure is found in the explicit form.
The concept of information (by Shannon) is generalized for quantum statistical ensembles, and the consistent quantum-theoretical form of the entropy defect principle is obtained. The efect of the irreversiblility of quantummechanical measurements on information transmission is analyzed. For the ensemble of two pure quantum states, the optimal measurement procedure is found in the explicit form.
In view of the fact that physical measurements represent transmission of information, a general definition based on the measure of lack of knowledge in information theory can be introduced for different entropies each of them corresponding to one particular kind of measurement. By means of this entropy concept the problem of the consistency of microscopic reversibility and maeroscopic irreversibility is studied. Under certain conditions it can be shown that the reversible microscopic equation of motion leads to the result that all entropies corresponding to reduced quantities, i.e., to quantities which do not determine the microscopic state of the system completely, can never decrease. However, it is to be noted that this behavior is symmetric in time, in the classical as well as in the quantum mechanical case. Irreversibility is so related on the one hand to incomplete description of a system, but on the other also to the fact that theoretical statements can be verified by experiments in the future only. The validity of the results obtained within the framework of ensemble theory for a single physical system is dtscussed. As applications of the general ideas a system of free particles and the Boltzmann gas are treated. (auth)
It is well known that a Shannon based definition of information entropy leads in the classical case to the Boltzmann definition of entropy. It is tempting to regard the Von Neumann entropy as the corresponding quantum mechanical definition. But the latter has little to do with information theory. Consequently we introduce a new definition of entropy that reflects the inherent uncertainty of quantum mechanical states. We derive for it an explicit expression, and discuss some of its general properties. We distinguish between the minimum uncertainty entropy of pure states, and the excess statistical entropy of mixtures.
Information plays an important role in our understanding of the physical world. Hence we propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical worlds, our measure reduces to the von Neumann and Shannon entropies, respectively. It can even be used in a quantum or classical setting where we are only allowed to perform a limited set of operations. In a world that admits superstrong correlations in the form of non-local boxes, our measure can be used to analyze protocols such as superstrong random access encodings and the violation of 'information causality'. However, we also show that in such a world no entropic measure can exhibit all the properties we commonly accept in a quantum setting. For example, there exists no 'reasonable' measure of conditional entropy that is subadditive. Finally, we prove a coding theorem for some theories that is analogous to the quantum and classical settings, providing us with an appealing operational interpretation.
Information theory, introduced by Claude Shannon in 1948, provides a mathematical model, predominantly probabilistic, for addressing the challenges associated with measuring the amount of information in a message and efficiently and reliably storing the message (compression and protection). This theory has always been intricately connected to communication theory. Information theory not only relies on communication theory but also draws from fields such as statistics, statistical physics, and inference theory. In this chapter, a concise overview is presented, covering the mathematical foundations of classical and quantum information, their manipulation and associated qualifications. The fundamental concepts of classical information theory, including Shannon entropy, joint entropy, conditional entropy, and mutual information, are introduced. Additionally, basic concepts related to quantum information and quantum correlation measurements are presented.
It is well known that a Shannon-based definition of information entropy leads in the classical case to the Boltzmann entropy. It is tempting to regard the von Neumann entropy as the corresponding quantum-mechanical definition. But the latter is problematic from the quantum information point of view. Consequently, we introduce a new definition of entropy that reflects the inherent uncertainty of quantum-mechanical states. We derive for it an explicit expression, and discuss some of its general properties. We distinguish between the minimum uncertainty entropy of pure states, and the excess statistical entropy of mixtures.
These notes (in French) provide a concise introduction to information theory, spanning its classical foundations: Shannon entropy, joint and conditional entropies, mutual information, statistical correlations, and Markov chains; as well as Shannon's source coding and channel capacity theorems, which govern the optimal compression and transmission of information through noisy channels. They also cover the quantum extensions of these concepts, including the density operator formalism, distances between quantum states, von Neumann entropy, coherent information, conditional entropy, entanglement theory, quantum discord, and quantum resource theory.