Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Cambridge University Press eBooks

Entropies and Relative Entropies

Gilad Gour

Published Apr 10, 2025• 0 citations
Publisher

Abstract

Chapter 6 builds upon the foundation of divergences from Chapter 5, advancing into entropies and relative entropies with an axiomatic approach, and the inclusion of the additivity axiom. The chapter delves into the classical and quantum relative entropies, establishing their core properties and revealing the significance of the KL-divergence introduced in Chapter 5, notably characterized by asymptotic continuity. Quantum relative entropies are addressed as generalizations of classical ones, with a focus on the conditions necessary for these measures in the quantum framework. Several variants of relative entropies are discussed, including Renyi relative entropies and their extensions to quantum domain such as the Petz quantum Renyi divergence, minimal quantum Renyi divergence, and the maximal quantum Renyi divergence. This discourse underlines the relevance of continuity and its relation to faithfulness in relative entropies. The concept of entropy is portrayed as a measure with a broad spectrum of interpretations and applications across fields, from thermodynamics and information theory to cosmology and economics.

DOI
10.1017/9781009560870.006

Related papers

α - z -Rényi relative entropies

Koenraad M. R. Audenaert, Nilanjana Datta

We consider a two-parameter family of Rényi relative entropies Dα,z(ρ ∥ σ) that are quantum generalisations of the classical Rényi divergence Dα(p ∥ q). This family includes many known relative entropies (or divergences) such as the quantum relative entropy, the recently defined quantum Rényi divergences, as well as the quantum Rényi relative entropies. All its members satisfy the quantum generalizations of Rényi’s axioms for a divergence. We consider the range of the parameters α, z for which the data-processing inequality holds. We also investigate a variety of limiting cases for the two parameters, obtaining explicit formulas for each one of them.

arXiv:1310.7178•Journal of Mathematical Physics•Feb 1, 2015•129 citations

Relative entropy via distribution of observables

George Androulakis, Tiju Cherian John

We obtain formulas for Petz–Rényi and Umegaki relative entropy from the idea of distribution of a positive self-adjoint operator. Classical results on Rényi and Kullback–Leibler divergences are applied to obtain new results and new proofs for some known results about Petz–Rényi and Umegaki relative entropy. Most important among these, is a necessary and sufficient condition for the finiteness of the Petz–Rényi [Formula: see text]-relative entropy. All of the results presented here are valid in both finite and infinite dimensions. In particular, these results are valid for states in Fock spaces and thus are applicable to continuous variable quantum information theory.

arXiv:2203.01964•Infinite Dimensional Analysis Quantum Probability and Related Topics•Aug 12, 2023•5 citations

Quantum Relative-alpha-Entropies: A Structural and Geometric Perspective

Sayantan Roy, Atin Gayen, Aditi Kar Gangopadhyay +1 more

Most quantum divergences derive their structure from classical f-divergences or Renyi-type constructions, a dependence that obscures several quantum geometric effects. We introduce a quantum relative-alpha-entropy that extends Umegaki's relative entropy while falling outside the f-divergence class. The proposed divergence exhibits a nonlinear convexity property, which yields a generalized convexity result for the Petz-Renyi divergence for alpha greater than one, complementing the known convexity for alpha less than one. It is additive under tensor products, invariant under unitary transformations, and depends only on the relative geometry of quantum states rather than their absolute magnitudes. Using Nussbaum-Szkola-type distributions, we also establish an exact correspondence of this divergence with classical relative-alpha-entropy. This reveals relative-alpha-entropy as a fundamentally geometric notion of quantum distinguishability not captured by existing divergence frameworks.

quant-pharXiv:2604.06908•Apr 9, 2026•0 citations

On quantum Rényi entropies: A new generalization and some properties

Martin Müller-Lennert, Frédéric Dupuis, Oleg Szehr +2 more

The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.

arXiv:1306.3142•Journal of Mathematical Physics•Dec 1, 2013•724 citations

Classical and Quantum Information Measures Characterizing Convertibility: An Axiomatic Approach

Frits Verhagen

In this PhD thesis, we take an axiomatic approach to studying multivariate divergences, which are measures of the information content of a tuple of classical or quantum states. These divergences are studied in the context of large-sample and catalytic convertibility of tuples of states. This type of convertibility is characterized by the ordering of an axiomatically defined family of divergences. In this thesis, we identify this family of divergences explicitly for two scenarios, one classical and one quantum. In the classical setting, we show that the relevant divergences are certain generalizations of the bivariate Rényi divergences. Unlike previous studies, we do not require the distributions to have the same support, yielding interesting new divergences. In the quantum setting, we consider pairs of classical-quantum states with pure component states, and find that majorization is characterized by all $α$-$z$ relative entropies for $α<1$. This demonstrates the first operational interpretation of these relative entropies.

quant-pharXiv:2610.16267•Oct 13, 2026•0 citations

Different quantum f-divergences and the reversibility of quantum operations

Fumio Hiai, Milán Mosonyi

The concept of classical [Formula: see text]-divergences gives a unified framework to construct and study measures of dissimilarity of probability distributions; special cases include the relative entropy and the Rényi divergences. Various quantum versions of this concept, and more narrowly, the concept of Rényi divergences, have been introduced in the literature with applications in quantum information theory; most notably Petz’ quasi-entropies (standard [Formula: see text]-divergences), Matsumoto’s maximal [Formula: see text]-divergences, measured [Formula: see text]-divergences, and sandwiched and [Formula: see text]-[Formula: see text]-Rényi divergences. In this paper, we give a systematic overview of the various concepts of quantum [Formula: see text]-divergences, with a main focus on their monotonicity under quantum operations, and the implications of the preservation of a quantum [Formula: see text]-divergence by a quantum operation. In particular, we compare the standard and the maximal [Formula: see text]-divergences regarding their ability to detect the reversibility of quantum operations. We also show that these two quantum [Formula: see text]-divergences are strictly different for non-commuting operators unless [Formula: see text] is a polynomial, and obtain some analogous partial results for the relation between the measured and the standard [Formula: see text]-divergences. We also study the monotonicity of the [Formula: see text]-[Formula: see text]-Rényi divergences under the special class of bistochastic maps that leave one of the arguments of the Rényi divergence invariant, and determine domains of the parameters [Formula: see text] where monotonicity holds, and where the preservation of the [Formula: see text]-[Formula: see text]-Rényi divergence implies the reversibility of the quantum operation.

arXiv:1604.03089•Reviews in Mathematical Physics•Jul 16, 2017•100 citations
Chapter 6 builds upon the foundation of divergences from Chapter 5, advancing into entropies and relative entropies with an axiomatic approach, and the inclusion of the additivity axiom. The chapter delves into the classical and quantum relative entropies, establishing their core properties and revealing the significance of the KL-divergence introduced in Chapter 5, notably characterized by asymptotic continuity. Quantum relative entropies are addressed as generalizations of classical ones, with a focus on the conditions necessary for these measures in the quantum framework. Several variants of relative entropies are discussed, including Renyi relative entropies and their extensions to quantum domain such as the Petz quantum Renyi divergence, minimal quantum Renyi divergence, and the maximal quantum Renyi divergence. This discourse underlines the relevance of continuity and its relation to faithfulness in relative entropies. The concept of entropy is portrayed as a measure with a broad spectrum of interpretations and applications across fields, from thermodynamics and information theory to cosmology and economics.
We consider a two-parameter family of Rényi relative entropies Dα,z(ρ ∥ σ) that are quantum generalisations of the classical Rényi divergence Dα(p ∥ q). This family includes many known relative entropies (or divergences) such as the quantum relative entropy, the recently defined quantum Rényi divergences, as well as the quantum Rényi relative entropies. All its members satisfy the quantum generalizations of Rényi’s axioms for a divergence. We consider the range of the parameters α, z for which the data-processing inequality holds. We also investigate a variety of limiting cases for the two parameters, obtaining explicit formulas for each one of them.
We obtain formulas for Petz–Rényi and Umegaki relative entropy from the idea of distribution of a positive self-adjoint operator. Classical results on Rényi and Kullback–Leibler divergences are applied to obtain new results and new proofs for some known results about Petz–Rényi and Umegaki relative entropy. Most important among these, is a necessary and sufficient condition for the finiteness of the Petz–Rényi [Formula: see text]-relative entropy. All of the results presented here are valid in both finite and infinite dimensions. In particular, these results are valid for states in Fock spaces and thus are applicable to continuous variable quantum information theory.
Most quantum divergences derive their structure from classical f-divergences or Renyi-type constructions, a dependence that obscures several quantum geometric effects. We introduce a quantum relative-alpha-entropy that extends Umegaki's relative entropy while falling outside the f-divergence class. The proposed divergence exhibits a nonlinear convexity property, which yields a generalized convexity result for the Petz-Renyi divergence for alpha greater than one, complementing the known convexity for alpha less than one. It is additive under tensor products, invariant under unitary transformations, and depends only on the relative geometry of quantum states rather than their absolute magnitudes. Using Nussbaum-Szkola-type distributions, we also establish an exact correspondence of this divergence with classical relative-alpha-entropy. This reveals relative-alpha-entropy as a fundamentally geometric notion of quantum distinguishability not captured by existing divergence frameworks.
The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.
In this PhD thesis, we take an axiomatic approach to studying multivariate divergences, which are measures of the information content of a tuple of classical or quantum states. These divergences are studied in the context of large-sample and catalytic convertibility of tuples of states. This type of convertibility is characterized by the ordering of an axiomatically defined family of divergences. In this thesis, we identify this family of divergences explicitly for two scenarios, one classical and one quantum. In the classical setting, we show that the relevant divergences are certain generalizations of the bivariate Rényi divergences. Unlike previous studies, we do not require the distributions to have the same support, yielding interesting new divergences. In the quantum setting, we consider pairs of classical-quantum states with pure component states, and find that majorization is characterized by all ααα-zzz relative entropies for α<1α<1α<1. This demonstrates the first operational interpretation of these relative entropies.
The concept of classical [Formula: see text]-divergences gives a unified framework to construct and study measures of dissimilarity of probability distributions; special cases include the relative entropy and the Rényi divergences. Various quantum versions of this concept, and more narrowly, the concept of Rényi divergences, have been introduced in the literature with applications in quantum information theory; most notably Petz’ quasi-entropies (standard [Formula: see text]-divergences), Matsumoto’s maximal [Formula: see text]-divergences, measured [Formula: see text]-divergences, and sandwiched and [Formula: see text]-[Formula: see text]-Rényi divergences. In this paper, we give a systematic overview of the various concepts of quantum [Formula: see text]-divergences, with a main focus on their monotonicity under quantum operations, and the implications of the preservation of a quantum [Formula: see text]-divergence by a quantum operation. In particular, we compare the standard and the maximal [Formula: see text]-divergences regarding their ability to detect the reversibility of quantum operations. We also show that these two quantum [Formula: see text]-divergences are strictly different for non-commuting operators unless [Formula: see text] is a polynomial, and obtain some analogous partial results for the relation between the measured and the standard [Formula: see text]-divergences. We also study the monotonicity of the [Formula: see text]-[Formula: see text]-Rényi divergences under the special class of bistochastic maps that leave one of the arguments of the Rényi divergence invariant, and determine domains of the parameters [Formula: see text] where monotonicity holds, and where the preservation of the [Formula: see text]-[Formula: see text]-Rényi divergence implies the reversibility of the quantum operation.