Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1509.00082 · Entropy

Quantum Information as a Non-Kolmogorovian Generalization of Shannon’s Theory

Federico Holik, G. M. Bosyk, Guido Bellomo

Published Oct 28, 2015• 22 citations
arXivHTMLPDF

Abstract

In this article, we discuss the formal structure of a generalized information theory based on the extension of the probability calculus of Kolmogorov to a (possibly) non-commutative setting. By studying this framework, we argue that quantum information can be considered as a particular case of a huge family of non-commutative extensions of its classical counterpart. In any conceivable information theory, the possibility of dealing with different kinds of information measures plays a key role. Here, we generalize a notion of state spectrum, allowing us to introduce a majorization relation and a new family of generalized entropic measures.

DOI
10.3390/e17117349

Related papers

Beyond Kolmogorov: Towards a Non-Commutative Measure Theory of Quantum Probability Spaces

Revista, Zen, MATH, 10

This paper explores the limitations of Kolmogorov's measure-theoretic foundation of probability in the context of quantum mechanics and proposes an extension towards a non-commutative framework. We delve into the mathematical structures underlying quantum probability spaces, focusing on operator algebras and their associated states. We analyze the challenges in defining joint probabilities for non-commuting observables and present an overview of alternative approaches based on operator algebras, quantum logic, and non-commutative integration. Furthermore, we investigate the applications of non-commutative measure theory in quantum information theory, quantum field theory, and the foundations of quantum mechanics, highlighting the potential for a more comprehensive understanding of probabilistic phenomena in quantum systems.

•Dec 5, 2025•0 citations

On non-commutativity in quantum theory (I): from classical to quantum probability

Luca Curcuraci

A central feature of quantum mechanics is the non-commutativity of operators used to describe physical observables. In this article, we present a critical analysis on the role of non-commutativity in quantum theory, focusing on its consequences in the probabilistic description. Typically, a random phenomenon is described using the measure-theoretic formulation of probability theory. Such a description can also be done using algebraic methods, which are capable to deal with non-commutative random variables (like in quantum mechanics). Here we propose a method to construct a non-commutative probability theory starting from an ordinary measure-theoretic description of probability. This will be done using the entropic uncertainty relations between random variables, in order to evaluate the presence of non-commutativity in their algebraic description.

arXiv:1803.04913•Mar 13, 2018•0 citations

Entropy in general physical theories

Anthony J Short, Stephanie Wehner

Information plays an important role in our understanding of the physical world. Hence we propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical worlds, our measure reduces to the von Neumann and Shannon entropies, respectively. It can even be used in a quantum or classical setting where we are only allowed to perform a limited set of operations. In a world that admits superstrong correlations in the form of non-local boxes, our measure can be used to analyze protocols such as superstrong random access encodings and the violation of 'information causality'. However, we also show that in such a world no entropic measure can exhibit all the properties we commonly accept in a quantum setting. For example, there exists no 'reasonable' measure of conditional entropy that is subadditive. Finally, we prove a coding theorem for some theories that is analogous to the quantum and classical settings, providing us with an appealing operational interpretation.

arXiv:0909.4801•New Journal of Physics•Mar 15, 2010•93 citations

On quantum Rényi entropies: A new generalization and some properties

Martin Müller-Lennert, Frédéric Dupuis, Oleg Szehr +2 more

The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.

arXiv:1306.3142•Journal of Mathematical Physics•Dec 1, 2013•724 citations

Classical Models for Quantum Information

Federico Holik, G. M. Bosyk

In this chapter, we will discuss the ontological status of the notion of quantuminformation. In the first part, we review the mathematical framework ofa generalized information theory. In this framework, probability theory will play a central role and, thus, we will devote Section 2 to it.We argue that the existence of probabilistic models that go beyond the classical and quantum realms, and the possibility of performing informational protocols in those models, allow us to claim that a generalized information theory can be conceived. Notice that this perspective is complementary to that of other research programs (see, e.g., Holik et al. 2015; Holik et al. 2016, and references therein). In the second part, we will consider the question about the ontology of the possible models satisfying the different instances of that generalized formalism. This will be the content of Section 3. Specifically, we want to study the role quantum mechanics plays in quantum information protocols; the question is whether there are other possible ontologies that can perform the same tasks. We will relate this problem to the existence of many examples of physical systems that are actually constructed using an essentially classical ontology but, on the other hand, are modeled by structures resembling the laws of quantum mechanics (e.g. Aerts 1998; Kwiat et al. 2000; Spreeuw 2001;Couder et al. 2005; Couder and Fort 2006; Qian et al. 2015). Their significancefor us relies in the fact that they can be used to perform quantum information protocols (though, in an inefficient way) (Man?ko et al. 2001; Bhattacharya et al. 2002; Francisco et al. 2006a, 2006b; Francisco and Ledesma 2008; Goldin et al. 2010). On this basis, we will explore the ontological implications of the existence of these simulations. Finally, in Section 4 we will draw our conclusions.

Cambridge University Press eBooks•Apr 24, 2017•0 citations

Non-Classical Information Entropy: A Statistical Physics Perspective

Jincheng Zhang

This paper introduces a novel definition of non-classical information entropy, rooted in the principles of statistical physics, particularly quantum mechanics. The core premise is that traditional information entropy, derived from classical probability theory, is insufficient to capture the essence of information within non-classical systems exhibiting phenomena such as superposition and entanglement. We propose a definition based on the concept of accessible states and their associated probabilities, extending the notion of entropy beyond the realm of purely deterministic systems. The paper details the mathematical formulation of this non-classical information entropy, denoted as *Hnc*, and presents a method for its calculation. The method relies on identifying the set of accessible states for a given system and then applying a generalized form of Shannon's entropy formula, modified to account for the inherent uncertainties associated with quantum mechanics. The resulting *Hnc* provides a quantitative measure of the information content within non-classical systems, offering a potential framework for studying information processing and dynamics in quantum environments. The key contribution lies in bridging the gap between information theory and non-classical statistical physics, offering a new lens through which to understand information in quantum systems.

•Sep 3, 2026•0 citations
In this article, we discuss the formal structure of a generalized information theory based on the extension of the probability calculus of Kolmogorov to a (possibly) non-commutative setting. By studying this framework, we argue that quantum information can be considered as a particular case of a huge family of non-commutative extensions of its classical counterpart. In any conceivable information theory, the possibility of dealing with different kinds of information measures plays a key role. Here, we generalize a notion of state spectrum, allowing us to introduce a majorization relation and a new family of generalized entropic measures.
This paper explores the limitations of Kolmogorov's measure-theoretic foundation of probability in the context of quantum mechanics and proposes an extension towards a non-commutative framework. We delve into the mathematical structures underlying quantum probability spaces, focusing on operator algebras and their associated states. We analyze the challenges in defining joint probabilities for non-commuting observables and present an overview of alternative approaches based on operator algebras, quantum logic, and non-commutative integration. Furthermore, we investigate the applications of non-commutative measure theory in quantum information theory, quantum field theory, and the foundations of quantum mechanics, highlighting the potential for a more comprehensive understanding of probabilistic phenomena in quantum systems.
A central feature of quantum mechanics is the non-commutativity of operators used to describe physical observables. In this article, we present a critical analysis on the role of non-commutativity in quantum theory, focusing on its consequences in the probabilistic description. Typically, a random phenomenon is described using the measure-theoretic formulation of probability theory. Such a description can also be done using algebraic methods, which are capable to deal with non-commutative random variables (like in quantum mechanics). Here we propose a method to construct a non-commutative probability theory starting from an ordinary measure-theoretic description of probability. This will be done using the entropic uncertainty relations between random variables, in order to evaluate the presence of non-commutativity in their algebraic description.
Information plays an important role in our understanding of the physical world. Hence we propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical worlds, our measure reduces to the von Neumann and Shannon entropies, respectively. It can even be used in a quantum or classical setting where we are only allowed to perform a limited set of operations. In a world that admits superstrong correlations in the form of non-local boxes, our measure can be used to analyze protocols such as superstrong random access encodings and the violation of 'information causality'. However, we also show that in such a world no entropic measure can exhibit all the properties we commonly accept in a quantum setting. For example, there exists no 'reasonable' measure of conditional entropy that is subadditive. Finally, we prove a coding theorem for some theories that is analogous to the quantum and classical settings, providing us with an appealing operational interpretation.
The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.
In this chapter, we will discuss the ontological status of the notion of quantuminformation. In the first part, we review the mathematical framework ofa generalized information theory. In this framework, probability theory will play a central role and, thus, we will devote Section 2 to it.We argue that the existence of probabilistic models that go beyond the classical and quantum realms, and the possibility of performing informational protocols in those models, allow us to claim that a generalized information theory can be conceived. Notice that this perspective is complementary to that of other research programs (see, e.g., Holik et al. 2015; Holik et al. 2016, and references therein). In the second part, we will consider the question about the ontology of the possible models satisfying the different instances of that generalized formalism. This will be the content of Section 3. Specifically, we want to study the role quantum mechanics plays in quantum information protocols; the question is whether there are other possible ontologies that can perform the same tasks. We will relate this problem to the existence of many examples of physical systems that are actually constructed using an essentially classical ontology but, on the other hand, are modeled by structures resembling the laws of quantum mechanics (e.g. Aerts 1998; Kwiat et al. 2000; Spreeuw 2001;Couder et al. 2005; Couder and Fort 2006; Qian et al. 2015). Their significancefor us relies in the fact that they can be used to perform quantum information protocols (though, in an inefficient way) (Man?ko et al. 2001; Bhattacharya et al. 2002; Francisco et al. 2006a, 2006b; Francisco and Ledesma 2008; Goldin et al. 2010). On this basis, we will explore the ontological implications of the existence of these simulations. Finally, in Section 4 we will draw our conclusions.
This paper introduces a novel definition of non-classical information entropy, rooted in the principles of statistical physics, particularly quantum mechanics. The core premise is that traditional information entropy, derived from classical probability theory, is insufficient to capture the essence of information within non-classical systems exhibiting phenomena such as superposition and entanglement. We propose a definition based on the concept of accessible states and their associated probabilities, extending the notion of entropy beyond the realm of purely deterministic systems. The paper details the mathematical formulation of this non-classical information entropy, denoted as *Hnc*, and presents a method for its calculation. The method relies on identifying the set of accessible states for a given system and then applying a generalized form of Shannon's entropy formula, modified to account for the inherent uncertainties associated with quantum mechanics. The resulting *Hnc* provides a quantitative measure of the information content within non-classical systems, offering a potential framework for studying information processing and dynamics in quantum environments. The key contribution lies in bridging the gap between information theory and non-classical statistical physics, offering a new lens through which to understand information in quantum systems.