We have seen that there is an intimate relationship between probability and information. The values we assign to probabilities depend on the information available, and information is a function of probabilities. This connection makes it inevitable that information will be an important concept in any statistical theory, including thermodynamics and, of course, quantum physics. The probabilistic interpretation of quantum theory has probability amplitudes rather than probabilities as the fundamental quantities. This feature, together with the associated superposition principle, is responsible for intrinsically quantum phenomena and gives quantum information theory its distinctive flavour. We shall see that the quantum rules for dynamical evolution and measurement, together with the existence of entangled states, have important implications for quantum information. They also make it possible to perform tasks which are either impractical or impossible within the classical domain. In describing these we shall make extensive use of simple but fundamental ideas in quantum theory. This chapter introduces the mathematical description of quantum physics and the concepts which will be employed in our study of quantum information.
We have seen that there is an intimate relationship between probability and information. The values we assign to probabilities depend on the information available, and information is a function of probabilities. This connection makes it inevitable that information will be an important concept in any statistical theory, including thermodynamics and, of course, quantum physics. The probabilistic interpretation of quantum theory has probability amplitudes rather than probabilities as the fundamental quantities. This feature, together with the associated superposition principle, is responsible for intrinsically quantum phenomena and gives quantum information theory its distinctive flavour. We shall see that the quantum rules for dynamical evolution and measurement, together with the existence of entangled states, have important implications for quantum information. They also make it possible to perform tasks which are either impractical or impossible within the classical domain. In describing these we shall make extensive use of simple but fundamental ideas in quantum theory. This chapter introduces the mathematical description of quantum physics and the concepts which will be employed in our study of quantum information.
The astute reader might have formed the impression that quantum in formation science is a rather qualitative discipline because we have not, as yet, explained how to quantify quantum information. There are three good reasons for leaving this important question until the final chapter. Firstly, quantum information theory is technically demanding and to treat it at an earlier stage might have suggested that our subject was more complicated than it is. Secondly, there is the fact that many of the ideas in the field, such as teleportation and quantum circuits, are unfamiliar and it was important to present these as simply as possible. Finally, and most importantly, the theory of quantum information is not yet fully developed. It has not yet reached, in particular, the level of completeness of its classical counterpart. For this reason we can answer only some of the many questions we would like a quantum theory of information to address. Having said this, we can say that however, there are beautiful and useful mathematical results and it seems certain that these will continue to form an important part of the theory as it develops. We noted in the introduction to Chapter 1 that ‘quantum mechanics is a probabilistic theory and so it was inevitable that a quantum information theory would be developed’. A presentation of at least the beginnings of a quantitative theory is the objective of this final chapter. The entropy or information derived from a given probability distribution is, as we have seen, a convenient measure of the uncertainty associated with the distribution. If many of the probabilities are large, so that many of the possible events are comparably likely, then the entropy will be large. If one probability is close to unity, however, then the entropy will be small. It is convenient to introduce entropy in quantum mechanics as a measure of the uncertainty, or lack of knowledge, of the form of the state vector. If we know that our system is in a particular pure state then the associated uncertainty or entropy should be zero. For mixed states, however, it will take a non-zero value.
Information theory, introduced by Claude Shannon in 1948, provides a mathematical model, predominantly probabilistic, for addressing the challenges associated with measuring the amount of information in a message and efficiently and reliably storing the message (compression and protection). This theory has always been intricately connected to communication theory. Information theory not only relies on communication theory but also draws from fields such as statistics, statistical physics, and inference theory. In this chapter, a concise overview is presented, covering the mathematical foundations of classical and quantum information, their manipulation and associated qualifications. The fundamental concepts of classical information theory, including Shannon entropy, joint entropy, conditional entropy, and mutual information, are introduced. Additionally, basic concepts related to quantum information and quantum correlation measurements are presented.
The science of information theory begins with the observation that there is a fundamental link between probabilities and information. As early as the mid eighteenth century, Bayes recognized that probabilities depend on what we know; if we acquire additional information then this modifies the probability. For example, the probability that it is raining when I leave for work in the morning is about 0.2, but if I look out of the window ten minutes before leaving and see that it is raining then this additional information adjusts the probability to in excess of 0.9. Information is a function of probabilities: it is the entropy associated with the probability distribution. This conclusion grew out of investigations into the physical nature of entropy by Boltzmann and his followers. The full power of entropy as the quantity of information was revealed by Shannon in his mathematical theory of communication. This work laid the foundations for the development of information and communications theory by proving two powerful theorems which limit our ability to communicate information. The link between probability and information has far wider application than just communications. Indeed, we can expect the ideas of information theory to be applicable to any statistical or probabilistic problem. Quantum mechanics is a probabilistic theory and so it was inevitable that a quantum information theory would be developed. In quantum theory, probabilities are secondary quantities calculated by taking the squared modulus of probability amplitudes and this gives rise to interference effects. Consider, for example, the famous two-slit experiment depicted in Fig. 1.1. A single particle launched at the slits can arrive at a point P on the screen by passing either through slit 1 or through slit 2. In classical statistical mechanics this leads to a probability . . . P = P1 + P2, (1.1) . . . where P1 and P2 are, respectively, the probabilities that the particle passed through slit 1 or slit 2 and went on to arrive at the point P.
Abstract Quantum information science is a new and rapidly developing discipline that studies the general laws governing the transmission, storage, and processing of information in systems that obey the laws of quantum mechanics. It makes extensive use of matrix theory and operator theory on Hilbert spaces to investigate the capabilities of such systems and to develop principles for their rational design. An important consequence of the development of quantum information science is a substantial clarification of the logical structure and foundations of quantum mechanics and of its relation to reality. These lectures are devoted to the foundations of the mathematical theory of quantum systems: states, observables, communication channels, their entropic and information characteristics, and quantum information-processing protocols. The lectures provide a detailed introduction to the statistical structure of quantum theory and the necessary background from classical information theory; hence, knowledge of the basic mathematical subjects—analysis, linear algebra, and probability theory—is sufficient for understanding the material. In the first part of the course, we use the “standard” statistical model of a quantum system, but consider it in comparison with the classical statistical description. A consistent development of this approach leads to a generalized statistical model of quantum mechanics, in which observables (in general, “unsharp”) are described by probability operator-valued measures, while evolutions (in general, irreversible) are described by completely positive maps. Introductory material on these concepts, which underlie mathematical models of quantum information systems in the presence of noise and errors and have numerous applications in quantum information science, is presented in the second part of the course.
Abstract The reconstruction of quantum physics has been connected with the interpretation of the quantum formalism, and has continued to be so with the recent deeper consideration of the relation of information to quantum states and processes. This recent form of reconstruction has mainly involved conceiving quantum theory on the basis of informational principles, providing new perspectives on physical correlations and entanglement that can be used to encode information. By contrast to the traditional, interpretational approach to the foundations of quantum mechanics, which attempts directly to establish the meaning of the elements of the theory and often touches on metaphysical issues, the newer, more purely reconstructive approach sometimes defers this task, focusing instead on the mathematical derivation of the theoretical apparatus from simple principles or axioms. In its most pure form, this sort of theory reconstruction is fundamentally the mathematical derivation of the elements of theory from explicitly presented, often operational principles involving a minimum of extra‐mathematical content. Here, a representative series of specifically information‐based treatments—from partial reconstructions that make connections with information to rigorous axiomatizations, including those involving the theories of generalized probability and abstract systems—is reviewed.
The article argues that-at least in certain interpretations, such as the one assumed in this article under the heading of "reality without realism"-the quantum-theoretical situation appears as follows: While-in terms of probabilistic predictions-connected to and connecting the information obtained in quantum phenomena, the mathematics of quantum theory (QM or QFT), which is continuous, does not represent and is discontinuous with both the emergence of quantum phenomena and the physics of these phenomena, phenomena that are physically discontinuous with each other as well. These phenomena, and thus this information, are described by classical physics. All actually available information (in the mathematical sense of information theory) is classical: it is composed of units, such as bits, that are-or are contained in-entities described by classical physics. On the other hand, classical physics cannot predict this information when it is created, as manifested in measuring instruments, in quantum experiments, while quantum theory can. In this epistemological sense, this information is quantum. The article designates the discontinuity between quantum theory and the emergence of quantum phenomena the "Heisenberg discontinuity", because it was introduced by W. Heisenberg along with QM, and the discontinuity between QM or QFT and the classical physics of quantum phenomena, the "Bohr discontinuity", because it was introduced as part of Bohr's interpretation of quantum phenomena and QM, under the assumption of Heisenberg discontinuity. Combining both discontinuities precludes QM or QFT from being connected to either physical reality, that ultimately responsible for quantum phenomena or that of these phenomena themselves, other than by means of probabilistic predictions concerning the information, classical in character, contained in quantum phenomena. The nature of quantum information is, in this view, defined by this situation. A major implication, discussed in the Conclusion, is the existence and arguably the necessity of two-classical and quantum-or with relativity, three and possibly more essentially different theories in fundamental physics.