Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1504.01635 · Quantum Information and Computation

Natural information measures for contextual probabilistic models

Federico Holik, Angelo Plastino, Manuel Sáenz

Published Jan 1, 2016• 7 citations
arXivHTMLPDF

Abstract

In this article we provide, from a novel perspective, arguments that support the idea that, in the wake of Cox’ approach to probability theory, von Neumann’s entropy should be the natural one in Quantum Mechanics. We also generalize the pertinent reasoning to more general orthomodular lattices, which reveals the structure of a general non-Boolean information theory.

DOI
10.26421/qic16.1-2-8

Related papers

A discussion on the origin of quantum probabilities

Federico Holik, Angelo Plastino, Manuel Sáenz

We study the origin of quantum probabilities as arising from non-boolean propositional-operational structures. We apply the method developed by Cox to non distributive lattices and develop an alternative formulation of non-Kolmogorvian probability measures for quantum mechanics. By generalizing the method presented in previous works, we outline a general framework for the deduction of probabilities in general propositional structures represented by lattices (including the non-distributive case).

arXiv:1211.4952•Nov 21, 2012•1 citation

Generalized Probabilities in Statistical Theories

Federico Holik, César Massri, Angelo Plastino +1 more

We discuss different formal frameworks for the description of generalized probabilities in statistical theories. We analyze the particular cases of probabilities appearing in classical and quantum mechanics and the approach to generalized probabilities based on convex sets. We argue for considering quantum probabilities as the natural probabilistic assignments for rational agents dealing with contextual probabilistic models. In this way, the formal structure of quantum probabilities as a non-Boolean probabilistic calculus is endowed with a natural interpretation.

arXiv:1406.0913•Quantum Reports•Jul 29, 2021•6 citations

Entropy and information causality in general probabilistic theories

Howard Barnum, Jonathan Barrett, Lisa Orloff Clark +5 more

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality (IC) recently proposed by Pawlowski et al (2009 arXiv:0905.2292). We consider two entropic quantities, which we term measurement and mixing entropy. In the context of classical and quantum theory, these coincide, being given by the Shannon and von Neumann entropies, respectively; in general, however, they are very different. In particular, while measurement entropy is easily seen to be concave, mixing entropy need not be. In fact, as we show, mixing entropy is not concave whenever the state space is a non-simplicial polytope. Thus, the condition that measurement and mixing entropies coincide is a strong constraint on possible theories. We call theories with this property monoentropic . Measurement entropy is subadditive, but not in general strongly subadditive. Equivalently, if we define the mutual information between two systems A and B by the usual formula I ( A : B )= H ( A )+ H ( B )- H ( AB ), where H denotes the measurement entropy and AB is a non-signaling composite of A and B , then it can happen that I ( A : BC )< I ( A : B ). This is relevant to IC in the sense of Pawlowski et al : we show that any monoentropic non-signaling theory in which measurement entropy is strongly subadditive, and also satisfies a version of the Holevo bound, is informationally causal, and on the other hand we observe that Popescu–Rohrlich boxes, which violate IC, also violate strong subadditivity. We also explore the interplay between measurement and mixing entropy and various natural conditions on theories that arise in quantum axiomatics.

arXiv:0909.5075•New Journal of Physics•Mar 15, 2010•135 citations

Entanglement as a More Fundamental Notion of Information than Shannon and von Neumann Entropy

Michael W Barry

Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression properties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement—the pattern of non-classical correlations between systems—is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies assign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical “truth” emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.

•Dec 27, 2025•0 citations

Probability in quantum mechanics

J. V. Corbett

Quantum mechanics is usually described in the terminology of probability theory even though the properties of the probability spaces associated with it are fundamentally different from the standard ones of probability theory. For example, Kolmogorov's axioms are not general enough to encompass the non-commutative situations that arise in quantum theory. There have been many attempts to generalise these axioms to meet the needs of quantum mechanics. The focus of these attempts has been the observation, first made by Birkhoff and von Neumann (1936), that the propositions associated with a quantum-mechanical system do not form a Boolean σ-algebra. There is almost universal agreement that the probability space associated with a quantum-mechanical system is given by the set of subspaces of a separable Hilbert space, but there is disagreement over the algebraic structure that this set represents. In the most popular model for the probability space of quantum mechanics the propositions are assumed to form an orthocomplemented lattice (Mackey (1963), Jauch (1968)). The fundamental concept here is that of a partial order, that is a binary relation that is reflexive and transitive but not symmetric. The partial order is interpreted as embodying the logical concept of implication in the set of propositions associated with the physical system. Although this model provides an acceptable mathematical expression of the probabilistic structure of quantum mechanics in that the subspaces of a separable Hilbert space give a representation of an ortho-complemented lattice, it has several deficiencies which will be discussed later.

Advances in Applied Probability•Dec 1, 1978•1 citation

Thermodynamics and the Structure of Quantum Theory as a Generalized Probabilistic Theory

Marius Krumm

This thesis investigates the connection between quantum theory, thermodynamics and information theory. Theories with structure similar to that of quantum theory are considered, mathematically described by the framework of "Generalized Probabilistic Theories". For these theories, a thought experiment by von Neumann is adapted to obtain a natural thermodynamic entropy definition, following a proposal by J. Barrett. Mathematical properties of this entropy are compared to physical consequences of the thought experiment. The validity of the second law of thermodynamics is investigated. In that context, observables and projective measurements are generalized to prove an entropy increase for projective measurements of ensembles. Information-theoretically motivated definitions of the entropy are compared to the entropy from the thermodynamic thought experiment. The conditions for the thermodynamic entropy to be well-defined are considered in greater detail. Several further properties of the theories under consideration (e.g. whether there is higher order interference, Pfister's state discrimination principle) and their relation to entropy are investigated.

arXiv:1508.03299•Aug 13, 2015•5 citations
In this article we provide, from a novel perspective, arguments that support the idea that, in the wake of Cox’ approach to probability theory, von Neumann’s entropy should be the natural one in Quantum Mechanics. We also generalize the pertinent reasoning to more general orthomodular lattices, which reveals the structure of a general non-Boolean information theory.
We discuss different formal frameworks for the description of generalized probabilities in statistical theories. We analyze the particular cases of probabilities appearing in classical and quantum mechanics and the approach to generalized probabilities based on convex sets. We argue for considering quantum probabilities as the natural probabilistic assignments for rational agents dealing with contextual probabilistic models. In this way, the formal structure of quantum probabilities as a non-Boolean probabilistic calculus is endowed with a natural interpretation.
We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality (IC) recently proposed by Pawlowski et al (2009 arXiv:0905.2292). We consider two entropic quantities, which we term measurement and mixing entropy. In the context of classical and quantum theory, these coincide, being given by the Shannon and von Neumann entropies, respectively; in general, however, they are very different. In particular, while measurement entropy is easily seen to be concave, mixing entropy need not be. In fact, as we show, mixing entropy is not concave whenever the state space is a non-simplicial polytope. Thus, the condition that measurement and mixing entropies coincide is a strong constraint on possible theories. We call theories with this property monoentropic . Measurement entropy is subadditive, but not in general strongly subadditive. Equivalently, if we define the mutual information between two systems A and B by the usual formula I ( A : B )= H ( A )+ H ( B )- H ( AB ), where H denotes the measurement entropy and AB is a non-signaling composite of A and B , then it can happen that I ( A : BC )< I ( A : B ). This is relevant to IC in the sense of Pawlowski et al : we show that any monoentropic non-signaling theory in which measurement entropy is strongly subadditive, and also satisfies a version of the Holevo bound, is informationally causal, and on the other hand we observe that Popescu–Rohrlich boxes, which violate IC, also violate strong subadditivity. We also explore the interplay between measurement and mixing entropy and various natural conditions on theories that arise in quantum axiomatics.
Classical information theory, built on Shannon entropy, and quantum information theory, built on von Neumann entropy, quantify uncertainty and compression properties of probability distributions and density operators. Both are powerful, but both treat information as a property of states of individual systems or ensembles. In this manuscript we argue that entanglement—the pattern of non-classical correlations between systems—is more fundamental than either Shannon or von Neumann information. We motivate this claim with a condensate thought experiment in which many bosons occupy the same single-particle state: Shannon and von Neumann entropies assign them identical information content, yet they can be distinguished by their distinct entanglement histories with external systems. Formally, states with identical marginal density operators but different purifications represent different global information, accessible only through their entanglement structure. Entropic quantities are then seen as coarse-grained summaries of this underlying relational information. We connect this perspective to an entanglement-geometric view of physics, including Entanglement Manifold Cosmology (EMC), in which spacetime and physical “truth” emerge from the geometry of correlations. The goal is an information-theoretic narrative that is rigorous enough for physics and information theory while readable to a non-specialist who is comfortable with basic linear algebra and quantum mechanics.
Quantum mechanics is usually described in the terminology of probability theory even though the properties of the probability spaces associated with it are fundamentally different from the standard ones of probability theory. For example, Kolmogorov's axioms are not general enough to encompass the non-commutative situations that arise in quantum theory. There have been many attempts to generalise these axioms to meet the needs of quantum mechanics. The focus of these attempts has been the observation, first made by Birkhoff and von Neumann (1936), that the propositions associated with a quantum-mechanical system do not form a Boolean σ-algebra. There is almost universal agreement that the probability space associated with a quantum-mechanical system is given by the set of subspaces of a separable Hilbert space, but there is disagreement over the algebraic structure that this set represents. In the most popular model for the probability space of quantum mechanics the propositions are assumed to form an orthocomplemented lattice (Mackey (1963), Jauch (1968)). The fundamental concept here is that of a partial order, that is a binary relation that is reflexive and transitive but not symmetric. The partial order is interpreted as embodying the logical concept of implication in the set of propositions associated with the physical system. Although this model provides an acceptable mathematical expression of the probabilistic structure of quantum mechanics in that the subspaces of a separable Hilbert space give a representation of an ortho-complemented lattice, it has several deficiencies which will be discussed later.
This thesis investigates the connection between quantum theory, thermodynamics and information theory. Theories with structure similar to that of quantum theory are considered, mathematically described by the framework of "Generalized Probabilistic Theories". For these theories, a thought experiment by von Neumann is adapted to obtain a natural thermodynamic entropy definition, following a proposal by J. Barrett. Mathematical properties of this entropy are compared to physical consequences of the thought experiment. The validity of the second law of thermodynamics is investigated. In that context, observables and projective measurements are generalized to prove an entropy increase for projective measurements of ensembles. Information-theoretically motivated definitions of the entropy are compared to the entropy from the thermodynamic thought experiment. The conditions for the thermodynamic entropy to be well-defined are considered in greater detail. Several further properties of the theories under consideration (e.g. whether there is higher order interference, Pfister's state discrimination principle) and their relation to entropy are investigated.