Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Communications in Theoretical Physics

Mutual Information and Relative Entropy of Sequential Effect Algebras

Wang Jia-Mei, Junde Wu, Cho Minhyung

Published Aug 1, 2010• 4 citations
Publisher

Abstract

In this paper, we introduce and investigate the mutual information and relative entropy on the sequential effect algebra, we also give a comparison of these mutual information and relative entropy with the classical ones by the venn diagrams. Finally, a nice example shows that the entropies of sequential effect algebra depend extremely on the order of its sequential product.

DOI
10.1088/0253-6102/54/2/03

Related papers

Mutual Information and Relative Entropy of Sequential Effect Algebras

Jia Wang

In this paper,we introduce and investigate the mutual information and relative entropy on the sequential effect algebra,we also give a comparison of these mutual information and relative entropy with the classical ones by the venn diagrams.Finally,a nice example shows that the entropies of sequential effect algebra depend extremely on the order of its sequential product.

理论物理通讯:英文版•Jan 1, 2010•0 citations

Rényi Entropy and Rényi Divergence in Sequential Effect Algebra

Zahra Eslami Giski

The aim of this study is to extend the results concerning the Shannon entropy and Kullback–Leibler divergence in sequential effect algebra to the case of Rényi entropy and Rényi divergence. For this purpose, the Rényi entropy of finite partitions in sequential effect algebra and its conditional version are proposed and the basic properties of these entropy measures are derived. In addition, the notion of Rényi divergence of a partition in sequential effect algebra is introduced and the basic properties of this quantity are studied. In particular, it is proved that the Kullback–Leibler divergence and Shannon’s entropy of partitions in a given sequential effect algebra can be obtained as limits of their Rényi divergence and Rényi entropy respectively. Finally, to illustrate the results, some numerical examples are presented.

Open Systems & Information Dynamics•Jun 1, 2020•1 citation

Mutual Information and Relative Entropy of Sequential Effect Algebras

理论物理通讯:英文版•Jan 1, 2010•1 citation

Numerical Calculation of Quantum Mutual Type Entropies

Noboru Watanabe

The quantum entropy was introduced by von Neumann around 1932, which describes the amont of information of the quantum state itself. It was extended by Ohya for C*‐systems. The quantum relative entropy was first defined by Umegaki for σ ‐finite von Neumann algebras, which denotes a certain difference between two states. It was extended by Araki and Uhlmann for general von Neumann algebras and *‐algebras, respectively. The development of communication theory is closely connected with study of entropy theory. In order to discuss the commuinication processes, we need at least two systems, such as input and output systems. The signal of the input system is carried through a physical device, which is called a channel. The mathematical representation of the channel is a mapping from the input state space to the output state space. The mutual entropy (information) defined by using the relative entropy between the product state consist of the input state and the output state and the compound state given by the communication process, expresses the amount of information correctly transmitted through the channel from the input system to the output system. In classical communication theory, the mutual entropy was formulated by using the joint probability distribution between the input system and the output system. The (semi‐classical) mutual entropies for classical input and quantum output were defined by several researchers. In fully quantum system, there does not exist the joint probability distribution in general. Instead of the joint probability distribution, Ohya invented the quantum (Ohya) compound state, and he introduced the fully quantum mutual entropy (information), which is called Ohya mutual entropy, for quantum input and output systems, describes the amount of information correctly sent from the quantum input system to the quantum output system through the quantum channel. It was extended by Ohya for general quantum systems. Recently Shor and Bennet et al took the coherent entropy and defined the mutual type entropy to discuss a sort of coding theorem for communication processes.In this paper, we concretely calculate these mutual entropy‐type measures for the attenuation channel in order to assay these abilities.

AIP conference proceedings•Jan 1, 2006•0 citations

Belavkin–Staszewski Relative Entropy, Conditional Entropy, and Mutual Information

Yuan Zhai, Bo Yang, Zhengjun Xi

Belavkin-Staszewski relative entropy can naturally characterize the effects of the possible noncommutativity of quantum states. In this paper, two new conditional entropy terms and four new mutual information terms are first defined by replacing quantum relative entropy with Belavkin-Staszewski relative entropy. Next, their basic properties are investigated, especially in classical-quantum settings. In particular, we show the weak concavity of the Belavkin-Staszewski conditional entropy and obtain the chain rule for the Belavkin-Staszewski mutual information. Finally, the subadditivity of the Belavkin-Staszewski relative entropy is established, i.e., the Belavkin-Staszewski relative entropy of a joint system is less than the sum of that of its corresponding subsystems with the help of some multiplicative and additive factors. Meanwhile, we also provide a certain subadditivity of the geometric Rényi relative entropy.

Entropy•Jun 17, 2022•8 citations

Properties of Sequential Products

Stanley Gudder

Our basic concept is the set $\mathcal{E}(H)$ of effects on a finite dimensional complex Hilbert space $H$. If $a,b\in\mathcal{E}(H)$, we define the sequential product $a[\mathcal{I}]b$ of $a$ then $b$. The sequential product depends on the operation $\mathcal{I}$ used to measure $a$. We begin by studying the properties of this sequential product. It is observed that $b\mapsto a[\mathcal{I}]b$ is an additive, convex morphism and we show by examples that $a\mapsto a[\mathcal{I}]b$ enjoys very few conditions. This is because a measurement of $a$ can interfere with a later measurement of $b$. We study sequential products relative to Kraus, Lüders and Holevo operations and find properties that characterize these operations. We consider repeatable effects and conditions on $a[\mathcal{I}]b$ that imply commutativity. We introduce the concept of an effect $b$ given an effect $a$ and study its properties. We next extend the sequential product to observables and instruments and develop statistical properties of real-valued observables. This is accomplished by employing corresponding stochastic operators. Finally, we introduce an uncertainty principle for conditioned observables.

arXiv:2307.16327•Jul 30, 2023•0 citations
In this paper, we introduce and investigate the mutual information and relative entropy on the sequential effect algebra, we also give a comparison of these mutual information and relative entropy with the classical ones by the venn diagrams. Finally, a nice example shows that the entropies of sequential effect algebra depend extremely on the order of its sequential product.
The aim of this study is to extend the results concerning the Shannon entropy and Kullback–Leibler divergence in sequential effect algebra to the case of Rényi entropy and Rényi divergence. For this purpose, the Rényi entropy of finite partitions in sequential effect algebra and its conditional version are proposed and the basic properties of these entropy measures are derived. In addition, the notion of Rényi divergence of a partition in sequential effect algebra is introduced and the basic properties of this quantity are studied. In particular, it is proved that the Kullback–Leibler divergence and Shannon’s entropy of partitions in a given sequential effect algebra can be obtained as limits of their Rényi divergence and Rényi entropy respectively. Finally, to illustrate the results, some numerical examples are presented.
The quantum entropy was introduced by von Neumann around 1932, which describes the amont of information of the quantum state itself. It was extended by Ohya for C*‐systems. The quantum relative entropy was first defined by Umegaki for σ ‐finite von Neumann algebras, which denotes a certain difference between two states. It was extended by Araki and Uhlmann for general von Neumann algebras and *‐algebras, respectively. The development of communication theory is closely connected with study of entropy theory. In order to discuss the commuinication processes, we need at least two systems, such as input and output systems. The signal of the input system is carried through a physical device, which is called a channel. The mathematical representation of the channel is a mapping from the input state space to the output state space. The mutual entropy (information) defined by using the relative entropy between the product state consist of the input state and the output state and the compound state given by the communication process, expresses the amount of information correctly transmitted through the channel from the input system to the output system. In classical communication theory, the mutual entropy was formulated by using the joint probability distribution between the input system and the output system. The (semi‐classical) mutual entropies for classical input and quantum output were defined by several researchers. In fully quantum system, there does not exist the joint probability distribution in general. Instead of the joint probability distribution, Ohya invented the quantum (Ohya) compound state, and he introduced the fully quantum mutual entropy (information), which is called Ohya mutual entropy, for quantum input and output systems, describes the amount of information correctly sent from the quantum input system to the quantum output system through the quantum channel. It was extended by Ohya for general quantum systems. Recently Shor and Bennet et al took the coherent entropy and defined the mutual type entropy to discuss a sort of coding theorem for communication processes.In this paper, we concretely calculate these mutual entropy‐type measures for the attenuation channel in order to assay these abilities.
Belavkin-Staszewski relative entropy can naturally characterize the effects of the possible noncommutativity of quantum states. In this paper, two new conditional entropy terms and four new mutual information terms are first defined by replacing quantum relative entropy with Belavkin-Staszewski relative entropy. Next, their basic properties are investigated, especially in classical-quantum settings. In particular, we show the weak concavity of the Belavkin-Staszewski conditional entropy and obtain the chain rule for the Belavkin-Staszewski mutual information. Finally, the subadditivity of the Belavkin-Staszewski relative entropy is established, i.e., the Belavkin-Staszewski relative entropy of a joint system is less than the sum of that of its corresponding subsystems with the help of some multiplicative and additive factors. Meanwhile, we also provide a certain subadditivity of the geometric Rényi relative entropy.
Our basic concept is the set E(H)\mathcal{E}(H)E(H) of effects on a finite dimensional complex Hilbert space HHH. If a,b∈E(H)a,b\in\mathcal{E}(H)a,b∈E(H), we define the sequential product a[I]ba[\mathcal{I}]ba[I]b of aaa then bbb. The sequential product depends on the operation I\mathcal{I}I used to measure aaa. We begin by studying the properties of this sequential product. It is observed that b↦a[I]bb\mapsto a[\mathcal{I}]bb↦a[I]b is an additive, convex morphism and we show by examples that a↦a[I]ba\mapsto a[\mathcal{I}]ba↦a[I]b enjoys very few conditions. This is because a measurement of aaa can interfere with a later measurement of bbb. We study sequential products relative to Kraus, Lüders and Holevo operations and find properties that characterize these operations. We consider repeatable effects and conditions on a[I]ba[\mathcal{I}]ba[I]b that imply commutativity. We introduce the concept of an effect bbb given an effect aaa and study its properties. We next extend the sequential product to observables and instruments and develop statistical properties of real-valued observables. This is accomplished by employing corresponding stochastic operators. Finally, we introduce an uncertainty principle for conditioned observables.