Abstract Besides the well-known Shannon entropy, there is a set of Shannon-like entropies which have applications in statistical and quantum physics. These entropies are functions of certain parameters and converge toward Shannon entropy when these parameters approach the value 1. We describe briefly the most important Shannon-like entropies and present their graphical representations. Their graphs look almost identical, though by superimposing them it appears that they are distinct and characteristic of each Shannon-like entropy. We try to formulate the alternative entropic uncertainty relations by means of the Shannon-like entropies and show that all of them equally well express the uncertainty principle of quantum physics.
The ordering of communication channels was first introduced by Shannon. In this paper, we aim to find a characterization of the Shannon ordering. We show that W' contains W if and only if W is the skew-composition of W' with a convex-product channel. This fact is used to derive a characterization of the Shannon ordering that is similar to the Blackwell-Sherman-Stein theorem. Two channels are said to be Shannon-equivalent if each one is contained in the other. We investigate the topologies that can be constructed on the space of Shannon-equivalent channels. We introduce the strong topology and the BRM metric on this space. Finally, we study the continuity of a few channel parameters and operations under the strong topology.
Jensen-Shannon divergence (JD) is a symmetrized and smoothed version of the most important divergence measure of information theory, Kullback divergence. As opposed to Kullback divergence it determines in a very direct way a metric; indeed, it is the square of a metric. We consider a family of divergence measures (${\text{JD}}_{\ensuremath{\alpha}}$ for $\ensuremath{\alpha}>0$), the Jensen divergences of order $\ensuremath{\alpha}$, which generalize JD as
JD1=JD. Using a result of Schoenberg, we prove that ${\text{JD}}_{\ensuremath{\alpha}}$ is the square of a metric for $\ensuremath{\alpha}∊(0,2]$, and that the resulting metric space of probability distributions can be isometrically embedded in a real Hilbert space. Quantum Jensen-Shannon divergence (QJD) is a symmetrized and smoothed version of quantum relative entropy and can be extended to a family of quantum Jensen divergences of order $\ensuremath{\alpha}$ $({\text{QJD}}_{\ensuremath{\alpha}})$. We strengthen results by Lamberti and co-workers by proving that for qubits and pure states, ${\text{QJD}}_{\ensuremath{\alpha}}^{1/2}$ is a metric space which can be isometrically embedded in a real Hilbert space when $\ensuremath{\alpha}∊(0,2]$. In analogy with Burbea and Rao's generalization of JD, we also define general QJD by associating a Jensen-type quantity to any weighted family of states. Appropriate interpretations of quantities introduced are discussed and bounds are derived in terms of the total variation and trace distance.