Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Addendum Entropy and information causality in general probabilistic theories

Howard Barnum, Jonathan Barrett, Lisa Orloff Clark, Matthew Leifer, Robert W. Spekkens, Nicholas Stepanik, Alexander Wilce, Robin Wilke

Published Jan 1, 2012• 0 citations
OpenAlex

Abstract

In this addendum to our paper (2010 New J. Phys. 12 033024), we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In this addendum to our paper [1], we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In [1], we defined notions of measurement and mixing entropy for a broad class of probabilistic theories (which includes finite-dimensional quantum theory). We defined a theory to be monoentropic if for every state of a system in the theory, the mixing entropy (denoted S) is equal to the measurement entropy (denoted H ). This broad class of theories has a notion of composite system, and of the ‘marginal state’ of a subsystem given a state for the composite system, so that the strong subadditivity inequality may be formulated for real-valued functions of states, including the measurement and mixing entropies. We proved the following theorem. Theorem 1 (theorem 4 of [1]). Suppose that a theory has the following properties: (1) it is monoentropic, meaning that measurement entropy equals mixing entropy for all systems, (2) its measurement entropy is strongly subadditive and (3) its measurement entropy satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. In [1] we noted that monoentropicity was only used to establish the technical condition of positivity of conditional information, H(A|C), defined as H(AC)− H(C), when A is classical. This condition does not hold for all theories in the broad class we consider. Shortly after submitting the final version of [1], but too late for inclusion therein, we noticed that it does, however, hold for all theories satisfying strong subadditivity, enabling us to strengthen our theorem as follows. Theorem 2. Suppose that a theory’s measurement entropy is strongly subadditive and satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. As noted in our earlier paper, one can replace the two premises of this theorem with the single premise that the measurement entropy satisfies the data processing inequality. To see that H(A|C)> 0 for classical A follows from strong subadditivity, we recall (from e.g. lemma 1 of [1]), that strong subadditivity is equivalent to the positivity of conditional mutual information, I (A : B|C)> 0. Letting A and B be perfectly correlated classical systems in this inequality, we have I (A : B|C)= H(A|C)+ H(B|C)− H(AB|C) = H(AC)− H(C)+ H(BC) − H(C)− H(ABC)+ H(C) = H(AC)+ H(BC)− H(ABC)− H(C). New Journal of Physics 14 (2012) 129401 (http://www.njp.org/)

Related papers

Entropy and information causality in general probabilistic theories

Howard Barnum, Jonathan Barrett, Lisa Orloff Clark +5 more

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality (IC) recently proposed by Pawlowski et al (2009 arXiv:0905.2292). We consider two entropic quantities, which we term measurement and mixing entropy. In the context of classical and quantum theory, these coincide, being given by the Shannon and von Neumann entropies, respectively; in general, however, they are very different. In particular, while measurement entropy is easily seen to be concave, mixing entropy need not be. In fact, as we show, mixing entropy is not concave whenever the state space is a non-simplicial polytope. Thus, the condition that measurement and mixing entropies coincide is a strong constraint on possible theories. We call theories with this property monoentropic . Measurement entropy is subadditive, but not in general strongly subadditive. Equivalently, if we define the mutual information between two systems A and B by the usual formula I ( A : B )= H ( A )+ H ( B )- H ( AB ), where H denotes the measurement entropy and AB is a non-signaling composite of A and B , then it can happen that I ( A : BC )< I ( A : B ). This is relevant to IC in the sense of Pawlowski et al : we show that any monoentropic non-signaling theory in which measurement entropy is strongly subadditive, and also satisfies a version of the Holevo bound, is informationally causal, and on the other hand we observe that Popescu–Rohrlich boxes, which violate IC, also violate strong subadditivity. We also explore the interplay between measurement and mixing entropy and various natural conditions on theories that arise in quantum axiomatics.

arXiv:0909.5075•New Journal of Physics•Mar 15, 2010•135 citations

Entropy and information causality in general probabilistic theories

Howard Barnum, Jonathan Barrett, Lisa Orloff Clark +5 more

In this addendum to our paper (2010 New J. Phys. 12 033024), we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper.

New Journal of Physics•Dec 5, 2012•16 citations

Reexamination of strong subadditivity: A quantum-correlation approach

Razieh Taghiabadi, Seyed Javad Akhtarshenas, Mohsen Sarbishaei

The strong subadditivity inequality of von Neumann entropy relates the entropy of subsystems of a tripartite state ${\ensuremath{\rho}}_{ABC}$ to that of the composite system. Here, we define ${\mathbit{T}}^{(a)}({\ensuremath{\rho}}_{ABC})$ as the extent to which ${\ensuremath{\rho}}_{ABC}$ fails to satisfy the strong subadditivity inequality $S({\ensuremath{\rho}}_{B})+S({\ensuremath{\rho}}_{C})\ensuremath{\le}S({\ensuremath{\rho}}_{AB})+S({\ensuremath{\rho}}_{AC})$ with equality and investigate its properties. In particular, by introducing auxiliary subsystem $E$, we consider any purification $|{\ensuremath{\psi}}_{ABCE}\ensuremath{\rangle}$ of ${\ensuremath{\rho}}_{ABC}$ and formulate ${\mathbit{T}}^{(a)}({\ensuremath{\rho}}_{ABC})$ as the extent to which the bipartite quantum correlations of ${\ensuremath{\rho}}_{AB}$ and ${\ensuremath{\rho}}_{AC}$, measured by entanglement of formation and quantum discord, change under the transformation $B\ensuremath{\rightarrow}BE$ and $C\ensuremath{\rightarrow}CE$. Invariance of quantum correlations of ${\ensuremath{\rho}}_{AB}$ and ${\ensuremath{\rho}}_{AC}$ under such transformation is shown to be a necessary and sufficient condition for vanishing ${\mathbit{T}}^{(a)}({\ensuremath{\rho}}_{ABC})$. Our approach allows one to characterize, intuitively, the structure of states for which the strong subadditivity is saturated. Moreover, along with providing a conservation law for quantum correlations of states for which the strong subadditivity inequality is satisfied with equality, we find that such states coincide with those that the Koashi-Winter monogamy relation is saturated.

arXiv:1611.07455•Physical Review A•Mar 13, 2017•2 citations

Inequalities for quantum entropy: A review with conditions for equality

Mary Beth Ruskai

This article presents self-contained proofs of the strong subadditivity inequality for von Neumann’s quantum entropy, S(ρ), and some related inequalities for the quantum relative entropy, most notably its convexity and its monotonicity under stochastic maps. Moreover, the approach presented here, which is based on Klein’s inequality and Lieb’s theorem that the function A→Tr eK+log A is concave, allows one to obtain conditions for equality. In the case of strong subadditivity, which states that S(ρ123)+S(ρ2)⩽S(ρ12)+S(ρ23) where the subscripts denote subsystems of a composite system, equality holds if and only if log ρ123=log ρ12−log ρ2+log ρ23. Using the fact that the Holevo bound on the accessible information in a quantum ensemble can be obtained as a consequence of the monotonicity of relative entropy, we show that equality can be attained for that bound only when the states in the ensemble commute. The article concludes with an Appendix giving a short description of Epstein’s elegant proof of Lieb’s theorem.

arXiv:quant-ph/0205064•Journal of Mathematical Physics•Sep 1, 2002•185 citations

Quantum Information and Entropy

Mark M. Wilde

In this chapter, we discuss several information measures that are important for quantifying the amount of information and correlations that are present in quantum systems. The first fundamental measure that we introduce is the von Neumann entropy (or simply quantum entropy ). It is the quantum generalization of the Shannon entropy, but it captures both classical and quantum uncertainty in a quantum state.1 The quantum entropy gives meaning to the notion of an information qubit . This notion is different from that of the physical qubit, which is the description of a quantum state of an electron or a photon. The information qubit is the fundamental quantum informational unit of measure, determining how much quantum information is present in a quantum system. The initial definitions here are analogous to the classical definitions of entropy, but we soon discover a radical departure from the intuitive classical notions from the previous chapter: the conditional quantum entropy can be negative for certain quantum states. In the classical world, this negativity simply does not occur, but it takes on a special meaning in quantum information theory. Pure quantum states that are entangled have stronger-than-classical correlations and are examples of states that have negative conditional entropy. The negative of the conditional quantum entropy is so important in quantum information theory that we even have a special name for it: the coherent information. We discover that the coherent information obeys a quantum data-processing inequality, placing it on a firm footing as a particular informational measure of quantum correlations. We then define several other quantum information measures, such as quantum mutual information, that bear similar definitions as in the classical world, but with Shannon entropies replaced with quantum entropies. This replacement may seem to make quantum entropy somewhat trivial on the surface, but a simple calculation reveals that a maximally entangled state on two qubits registers two bits of quantum mutual information (recall that the largest the mutual information can be in the classical world is one bit for the case of two maximally correlated bits). We then discuss several entropy inequalities that play an important role in quantum information processing: the monotonicity of quantum relative entropy, strong subadditivity, the quantum data-processing inequalities, and continuity of quantum entropy.

Cambridge University Press eBooks•Nov 2, 2016•0 citations

Entropy in general physical theories

Anthony J Short, Stephanie Wehner

Information plays an important role in our understanding of the physical world. Hence we propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical worlds, our measure reduces to the von Neumann and Shannon entropies, respectively. It can even be used in a quantum or classical setting where we are only allowed to perform a limited set of operations. In a world that admits superstrong correlations in the form of non-local boxes, our measure can be used to analyze protocols such as superstrong random access encodings and the violation of 'information causality'. However, we also show that in such a world no entropic measure can exhibit all the properties we commonly accept in a quantum setting. For example, there exists no 'reasonable' measure of conditional entropy that is subadditive. Finally, we prove a coding theorem for some theories that is analogous to the quantum and classical settings, providing us with an appealing operational interpretation.

arXiv:0909.4801•New Journal of Physics•Mar 15, 2010•93 citations
In this addendum to our paper (2010 New J. Phys. 12 033024), we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In this addendum to our paper [1], we point out that an elementary consequence of the strong subadditivity inequality allows us to strengthen one of the main conclusions of that paper. In [1], we defined notions of measurement and mixing entropy for a broad class of probabilistic theories (which includes finite-dimensional quantum theory). We defined a theory to be monoentropic if for every state of a system in the theory, the mixing entropy (denoted S) is equal to the measurement entropy (denoted H ). This broad class of theories has a notion of composite system, and of the ‘marginal state’ of a subsystem given a state for the composite system, so that the strong subadditivity inequality may be formulated for real-valued functions of states, including the measurement and mixing entropies. We proved the following theorem. Theorem 1 (theorem 4 of [1]). Suppose that a theory has the following properties: (1) it is monoentropic, meaning that measurement entropy equals mixing entropy for all systems, (2) its measurement entropy is strongly subadditive and (3) its measurement entropy satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. In [1] we noted that monoentropicity was only used to establish the technical condition of positivity of conditional information, H(A|C), defined as H(AC)− H(C), when A is classical. This condition does not hold for all theories in the broad class we consider. Shortly after submitting the final version of [1], but too late for inclusion therein, we noticed that it does, however, hold for all theories satisfying strong subadditivity, enabling us to strengthen our theorem as follows. Theorem 2. Suppose that a theory’s measurement entropy is strongly subadditive and satisfies the Holevo bound. Then the theory satisfies information causality. It follows that any theory satisfying these conditions cannot violate Tsirel’son’s bound. As noted in our earlier paper, one can replace the two premises of this theorem with the single premise that the measurement entropy satisfies the data processing inequality. To see that H(A|C)> 0 for classical A follows from strong subadditivity, we recall (from e.g. lemma 1 of [1]), that strong subadditivity is equivalent to the positivity of conditional mutual information, I (A : B|C)> 0. Letting A and B be perfectly correlated classical systems in this inequality, we have I (A : B|C)= H(A|C)+ H(B|C)− H(AB|C) = H(AC)− H(C)+ H(BC) − H(C)− H(ABC)+ H(C) = H(AC)+ H(BC)− H(ABC)− H(C). New Journal of Physics 14 (2012) 129401 (http://www.njp.org/)
We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality (IC) recently proposed by Pawlowski et al (2009 arXiv:0905.2292). We consider two entropic quantities, which we term measurement and mixing entropy. In the context of classical and quantum theory, these coincide, being given by the Shannon and von Neumann entropies, respectively; in general, however, they are very different. In particular, while measurement entropy is easily seen to be concave, mixing entropy need not be. In fact, as we show, mixing entropy is not concave whenever the state space is a non-simplicial polytope. Thus, the condition that measurement and mixing entropies coincide is a strong constraint on possible theories. We call theories with this property monoentropic . Measurement entropy is subadditive, but not in general strongly subadditive. Equivalently, if we define the mutual information between two systems A and B by the usual formula I ( A : B )= H ( A )+ H ( B )- H ( AB ), where H denotes the measurement entropy and AB is a non-signaling composite of A and B , then it can happen that I ( A : BC )< I ( A : B ). This is relevant to IC in the sense of Pawlowski et al : we show that any monoentropic non-signaling theory in which measurement entropy is strongly subadditive, and also satisfies a version of the Holevo bound, is informationally causal, and on the other hand we observe that Popescu–Rohrlich boxes, which violate IC, also violate strong subadditivity. We also explore the interplay between measurement and mixing entropy and various natural conditions on theories that arise in quantum axiomatics.
The strong subadditivity inequality of von Neumann entropy relates the entropy of subsystems of a tripartite state ${\ensuremath{\rho}}_{ABC}$ to that of the composite system. Here, we define ${\mathbit{T}}^{(a)}({\ensuremath{\rho}}_{ABC})$ as the extent to which ${\ensuremath{\rho}}_{ABC}$ fails to satisfy the strong subadditivity inequality $S({\ensuremath{\rho}}_{B})+S({\ensuremath{\rho}}_{C})\ensuremath{\le}S({\ensuremath{\rho}}_{AB})+S({\ensuremath{\rho}}_{AC})$ with equality and investigate its properties. In particular, by introducing auxiliary subsystem EEE, we consider any purification $|{\ensuremath{\psi}}_{ABCE}\ensuremath{\rangle}$ of ${\ensuremath{\rho}}_{ABC}$ and formulate ${\mathbit{T}}^{(a)}({\ensuremath{\rho}}_{ABC})$ as the extent to which the bipartite quantum correlations of ${\ensuremath{\rho}}_{AB}$ and ${\ensuremath{\rho}}_{AC}$, measured by entanglement of formation and quantum discord, change under the transformation $B\ensuremath{\rightarrow}BE$ and $C\ensuremath{\rightarrow}CE$. Invariance of quantum correlations of ${\ensuremath{\rho}}_{AB}$ and ${\ensuremath{\rho}}_{AC}$ under such transformation is shown to be a necessary and sufficient condition for vanishing ${\mathbit{T}}^{(a)}({\ensuremath{\rho}}_{ABC})$. Our approach allows one to characterize, intuitively, the structure of states for which the strong subadditivity is saturated. Moreover, along with providing a conservation law for quantum correlations of states for which the strong subadditivity inequality is satisfied with equality, we find that such states coincide with those that the Koashi-Winter monogamy relation is saturated.
This article presents self-contained proofs of the strong subadditivity inequality for von Neumann’s quantum entropy, S(ρ), and some related inequalities for the quantum relative entropy, most notably its convexity and its monotonicity under stochastic maps. Moreover, the approach presented here, which is based on Klein’s inequality and Lieb’s theorem that the function A→Tr eK+log A is concave, allows one to obtain conditions for equality. In the case of strong subadditivity, which states that S(ρ123)+S(ρ2)⩽S(ρ12)+S(ρ23) where the subscripts denote subsystems of a composite system, equality holds if and only if log ρ123=log ρ12−log ρ2+log ρ23. Using the fact that the Holevo bound on the accessible information in a quantum ensemble can be obtained as a consequence of the monotonicity of relative entropy, we show that equality can be attained for that bound only when the states in the ensemble commute. The article concludes with an Appendix giving a short description of Epstein’s elegant proof of Lieb’s theorem.
In this chapter, we discuss several information measures that are important for quantifying the amount of information and correlations that are present in quantum systems. The first fundamental measure that we introduce is the von Neumann entropy (or simply quantum entropy ). It is the quantum generalization of the Shannon entropy, but it captures both classical and quantum uncertainty in a quantum state.1 The quantum entropy gives meaning to the notion of an information qubit . This notion is different from that of the physical qubit, which is the description of a quantum state of an electron or a photon. The information qubit is the fundamental quantum informational unit of measure, determining how much quantum information is present in a quantum system. The initial definitions here are analogous to the classical definitions of entropy, but we soon discover a radical departure from the intuitive classical notions from the previous chapter: the conditional quantum entropy can be negative for certain quantum states. In the classical world, this negativity simply does not occur, but it takes on a special meaning in quantum information theory. Pure quantum states that are entangled have stronger-than-classical correlations and are examples of states that have negative conditional entropy. The negative of the conditional quantum entropy is so important in quantum information theory that we even have a special name for it: the coherent information. We discover that the coherent information obeys a quantum data-processing inequality, placing it on a firm footing as a particular informational measure of quantum correlations. We then define several other quantum information measures, such as quantum mutual information, that bear similar definitions as in the classical world, but with Shannon entropies replaced with quantum entropies. This replacement may seem to make quantum entropy somewhat trivial on the surface, but a simple calculation reveals that a maximally entangled state on two qubits registers two bits of quantum mutual information (recall that the largest the mutual information can be in the classical world is one bit for the case of two maximally correlated bits). We then discuss several entropy inequalities that play an important role in quantum information processing: the monotonicity of quantum relative entropy, strong subadditivity, the quantum data-processing inequalities, and continuity of quantum entropy.
Information plays an important role in our understanding of the physical world. Hence we propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical worlds, our measure reduces to the von Neumann and Shannon entropies, respectively. It can even be used in a quantum or classical setting where we are only allowed to perform a limited set of operations. In a world that admits superstrong correlations in the form of non-local boxes, our measure can be used to analyze protocols such as superstrong random access encodings and the violation of 'information causality'. However, we also show that in such a world no entropic measure can exhibit all the properties we commonly accept in a quantum setting. For example, there exists no 'reasonable' measure of conditional entropy that is subadditive. Finally, we prove a coding theorem for some theories that is analogous to the quantum and classical settings, providing us with an appealing operational interpretation.