A colloquial interpretation of entropy is that it is the knowledge gained upon learning the outcome of a random experiment. Conditional entropy is then interpreted as the knowledge gained upon learning the outcome of one random experiment after learning the outcome of another, possibly statistically dependent, random experiment. In the classical world, entropy and conditional entropy take only non-negative values, consistent with the intuition that one has regarding the aforementioned interpretations. However, for certain entangled states, one obtains negative values when evaluating commonly accepted and information-theoretically justified formulas for the quantum conditional entropy, leading to the confounding conclusion that one can know less than nothing in the quantum world. Here, we introduce a physically motivated framework for defining quantum conditional entropy, based on two simple postulates inspired by the second law of thermodynamics (non-decrease of entropy) and extensivity of entropy, and we argue that all plausible definitions of quantum conditional entropy should respect these two postulates. We then prove that all plausible quantum conditional entropies take on negative values for certain entangled states, so that it is inevitable that one can know less than nothing in the quantum world. All of our arguments are based on constructions of physical processes that respect the first postulate, the one inspired by the second law of thermodynamics.
A colloquial interpretation of entropy is that it is the knowledge gained upon learning the outcome of a random experiment. Conditional entropy is then interpreted as the knowledge gained upon learning the outcome of one random experiment after learning the outcome of another, possibly statistically dependent, random experiment. In the classical world, entropy and conditional entropy take only non-negative values, consistent with the intuition that one has regarding the aforementioned interpretations. However, for certain entangled states, one obtains negative values when evaluating commonly accepted and information-theoretically justified formulas for the quantum conditional entropy, leading to the confounding conclusion that one can know less than nothing in the quantum world. Here, we introduce a physically motivated framework for defining quantum conditional entropy, based on two simple postulates inspired by the second law of thermodynamics (non-decrease of entropy) and extensivity of entropy, and we argue that all plausible definitions of quantum conditional entropy should respect these two postulates. We then prove that all plausible quantum conditional entropies take on negative values for certain entangled states, so that it is inevitable that one can know less than nothing in the quantum world. All of our arguments are based on constructions of physical processes that respect the first postulate, the one inspired by the second law of thermodynamics.
In this chapter, we discuss several information measures that are important for quantifying the amount of information and correlations that are present in quantum systems. The first fundamental measure that we introduce is the von Neumann entropy (or simply quantum entropy ). It is the quantum generalization of the Shannon entropy, but it captures both classical and quantum uncertainty in a quantum state.1 The quantum entropy gives meaning to the notion of an information qubit . This notion is different from that of the physical qubit, which is the description of a quantum state of an electron or a photon. The information qubit is the fundamental quantum informational unit of measure, determining how much quantum information is present in a quantum system. The initial definitions here are analogous to the classical definitions of entropy, but we soon discover a radical departure from the intuitive classical notions from the previous chapter: the conditional quantum entropy can be negative for certain quantum states. In the classical world, this negativity simply does not occur, but it takes on a special meaning in quantum information theory. Pure quantum states that are entangled have stronger-than-classical correlations and are examples of states that have negative conditional entropy. The negative of the conditional quantum entropy is so important in quantum information theory that we even have a special name for it: the coherent information. We discover that the coherent information obeys a quantum data-processing inequality, placing it on a firm footing as a particular informational measure of quantum correlations. We then define several other quantum information measures, such as quantum mutual information, that bear similar definitions as in the classical world, but with Shannon entropies replaced with quantum entropies. This replacement may seem to make quantum entropy somewhat trivial on the surface, but a simple calculation reveals that a maximally entangled state on two qubits registers two bits of quantum mutual information (recall that the largest the mutual information can be in the classical world is one bit for the case of two maximally correlated bits). We then discuss several entropy inequalities that play an important role in quantum information processing: the monotonicity of quantum relative entropy, strong subadditivity, the quantum data-processing inequalities, and continuity of quantum entropy.
We introduce an axiomatic approach for characterizing quantum conditional entropy. Our approach relies on two physically motivated axioms: monotonicity under conditional majorization and additivity. We show that these two axioms provide sufficient structure that enable us to derive several key properties applicable to all quantum conditional entropies studied in the literature. Specifically, we prove that any quantum conditional entropy must be negative on certain entangled states and must equal -log(d) on dxd maximally entangled states. We also prove the non-negativity of conditional entropy on separable states, and we provide a generic definition for the dual of a quantum conditional entropy. Finally, we develop an operational approach for characterizing quantum conditional entropy via games of chance, and we show that, for the classical case, this complementary approach yields the same ordering as the axiomatic approach.
Chapter 7 discusses quantum conditional entropy, extending the concept of conditional majorization and introducing the notion of negative quantum conditional entropy. The chapter starts with the basic definition of conditional entropy, exploring its key properties like monotonicity and additivity. It further delves into the concepts of conditional min- and max-entropies, emphasizing their roles in quantifying uncertainty in quantum states and their operational significance in quantum information theory. The text presents conditional entropy as a measure sensitive to the effects of entanglement, showing that negative conditional entropy is a distinctive feature of quantum systems, contrasting with the classical domain where entropy values are nonnegative. This negativity is particularly pronounced in the context of maximally entangled states and is connected to the fundamental differences between classical and quantum information processing. Moreover, the chapter includes theorems and exercises to solidify understanding, like the invariance of conditional entropy under local isometric channels and its reduction to entropy for product states. It concludes by underscoring the inevitability of negative conditional entropy in quantum systems, a topic of both theoretical and practical importance in the quantum domain.
The Heisenberg uncertainty principle is one of the most famous features of quantum mechanics. However, the non-determinism implied by the Heisenberg uncertainty principle --- together with other prominent aspects of quantum mechanics such as superposition, entanglement, and nonlocality --- poses deep puzzles about the underlying physical reality, even while these same features are at the heart of exciting developments such as quantum cryptography, algorithms, and computing. These puzzles might be resolved if the mathematical structure of quantum mechanics were built up from physically interpretable axioms, but it is not. We propose three physically-based axioms which together characterize the simplest quantum system, namely the qubit. Our starting point is the class of all no-signaling theories. Each such theory can be regarded as a family of empirical models, and we proceed to associate entropies, i.e., measures of information, with these models. To do this, we move to phase space and impose the condition that entropies are real-valued. This requirement, which we call the Information Reality Principle, arises because in order to represent all no-signaling theories (including quantum mechanics itself) in phase space, it is necessary to allow negative probabilities (Wigner [1932]). Our second and third principles take two important features of quantum mechanics and turn them into deliberately chosen physical axioms. One axiom is an Uncertainty Principle, stated in terms of entropy. The other axiom is an Unbiasedness Principle, which requires that whenever there is complete certainty about the outcome of a measurement in one of three mutually orthogonal directions, there must be maximal uncertainty about the outcomes in each of the two other directions.
We define a quantum entropy conditioned on postselection which has the von Neumann entropy of pure states as a special case. This conditional entropy can take negative values, which is consistent with part of a quantum system containing less information than the whole, which can be in a pure state. The definition is based on generalized density operators for postselected ensembles. The corresponding density operators are consistent with the quantum generalization of classical conditional probabilities following Dirac's formalism of quasiprobability distributions.
The measurement postulate of quantum theory stands in conflict with the laws of thermodynamics and has evoked debate regarding what actually constitutes a measurement. With the help of modern quantum statistical mechanics, we take the first step in formalizing the hypothesis that quantum measurements are driven by the natural tendency of closed systems to maximize entropy, a notion that we call the measurement-equilibration hypothesis. In this paradigm, we investigate how classical measurement outcomes can emerge within a purely unitary framework, and find that (1) the interactions used in standard measurement models fail to spontaneously encode information classically and (2) while ideal projective measurements are impossible, one can (for a given form of Hamiltonian) approximate them exponentially well as more physical systems are collected together into an “observer” system. We thus lay the groundwork for self-contained models of quantum measurement, proposing improvements to our simple scheme.