Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression properties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement—the pattern of non-classical correlations between systems—is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies assign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical “truth” emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.
Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression properties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement—the pattern of non-classical correlations between systems—is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies assign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical “truth” emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.
Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression proper ties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement the pattern of non-classical correlations be tween systems is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies as sign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical truth emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.
This paper explores the fundamental relationship between the geometry of entanglement and von Neumann entropy, shedding light on the intricate nature of quantum correlations. We provide a comprehensive overview of entanglement, highlighting its crucial role in quantum mechanics. Our focus centers on the connection between entanglement, von Neumann entropy, a measure of the information content within quantum systems and the geometry of composite Hilbert spaces. We discuss various methods for quantifying and characterizing entanglement through a geometric perspective and elucidate how this connection unveils the nature of quantum entanglement, offering valuable insights into the underlying structure of quantum systems. This study underscores the significance of geometry as a key tool for understanding the rich landscape of quantum correlations and their implications across various domains of physics and information theory. An example of entanglement as an indispensable resource for the task of state teleportation is presented at the end.
The idea that information can be localized is pervasive in physics. In thermodynamics, entropy flows from one reservoir to another, and in quantum gravity, the entropy content of some spatial regions is bounded. In quantum information theory, information is transmitted from one place to another, and entanglement can provide an advantage when there are constraints on such transmission.
Shannon entropy quantifies localizable information in the sense that marginalization defines an outer measure on the set of parts of a classical multipartite system. In contrast, von Neumann entropy does not quantify localizable information in this sense. However, a variant of von Neumann entropy, which originates in noncommutative geometry, does.
We prove that this adjusted von Neumann entropy is the minimum quantum entropy that quantifies localizable information. We also prove that this is the unique quantum entropy that characterizes Bell states in terms of redundant information, directly generalizing the classical case. We work with finite-dimensional C∗-algebras throughout, modeling finite quantum systems that may have superselection sectors.
These notes (in French) provide a concise introduction to information theory, spanning its classical foundations: Shannon entropy, joint and conditional entropies, mutual information, statistical correlations, and Markov chains; as well as Shannon's source coding and channel capacity theorems, which govern the optimal compression and transmission of information through noisy channels. They also cover the quantum extensions of these concepts, including the density operator formalism, distances between quantum states, von Neumann entropy, coherent information, conditional entropy, entanglement theory, quantum discord, and quantum resource theory.
In this chapter, we discuss several information measures that are important for quantifying the amount of information and correlations that are present in quantum systems. The first fundamental measure that we introduce is the von Neumann entropy (or simply quantum entropy ). It is the quantum generalization of the Shannon entropy, but it captures both classical and quantum uncertainty in a quantum state.1 The quantum entropy gives meaning to the notion of an information qubit . This notion is different from that of the physical qubit, which is the description of a quantum state of an electron or a photon. The information qubit is the fundamental quantum informational unit of measure, determining how much quantum information is present in a quantum system. The initial definitions here are analogous to the classical definitions of entropy, but we soon discover a radical departure from the intuitive classical notions from the previous chapter: the conditional quantum entropy can be negative for certain quantum states. In the classical world, this negativity simply does not occur, but it takes on a special meaning in quantum information theory. Pure quantum states that are entangled have stronger-than-classical correlations and are examples of states that have negative conditional entropy. The negative of the conditional quantum entropy is so important in quantum information theory that we even have a special name for it: the coherent information. We discover that the coherent information obeys a quantum data-processing inequality, placing it on a firm footing as a particular informational measure of quantum correlations. We then define several other quantum information measures, such as quantum mutual information, that bear similar definitions as in the classical world, but with Shannon entropies replaced with quantum entropies. This replacement may seem to make quantum entropy somewhat trivial on the surface, but a simple calculation reveals that a maximally entangled state on two qubits registers two bits of quantum mutual information (recall that the largest the mutual information can be in the classical world is one bit for the case of two maximally correlated bits). We then discuss several entropy inequalities that play an important role in quantum information processing: the monotonicity of quantum relative entropy, strong subadditivity, the quantum data-processing inequalities, and continuity of quantum entropy.
This paper proposes a novel approach to entropy compression leveraging the unique properties of quantum entanglement. We demonstrate that, through the careful design of entangled states, it is possible to achieve compression rates exceeding those predicted by the classical Shannon limit. The core mechanism relies on encoding information within the quantum state distribution of an entangled state and exploiting the non-classical correlations inherent in entanglement for efficient probability distribution compression. Unlike traditional entropy compression methods which rely on statistical properties of classical information, our approach directly utilizes the correlations provided by entanglement, offering a fundamentally different strategy. We formulate the theoretical framework, outlining the key mathematical concepts and presenting a detailed analysis of the compression process. The central argument is that entanglement allows for a more effective representation of information than is possible with purely classical distributions, leading to a demonstrable advantage in compression. This work challenges the conventional understanding of entropy and compression, suggesting a new paradigm where quantum phenomena can be harnessed to surpass classical limitations. The presented model incorporates the concepts of entropy, entanglement entropy, and quantum state tomography to provide a comprehensive framework for this novel compression technique. The theoretical foundation is built upon the principles of quantum information theory, with a particular focus on the role of entanglement in information processing and storage. ---