Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1304.0036 · IEEE Transactions on Information Theory

Tight Bound on Relative Entropy by Entropy Difference

David Reeb, Michael M. Wolf

Published Jan 6, 2015• 45 citations
arXivHTMLPDF

Abstract

We prove a lower bound on the relative entropy between two finite-dimensional states in terms of their entropy difference and the dimension of the underlying space. The inequality is tight in the sense that equality can be attained for any prescribed value of the entropy difference, both for quantum and classical systems. We outline implications for information theory and thermodynamics, such as a necessary condition for a process to be close to thermodynamic reversibility, or an easily computable lower bound on the classical channel capacity. Furthermore, we derive a tight upper bound, uniform for all states of a given dimension, on the variance of the surprisal, whose thermodynamic meaning is that of heat capacity.

DOI
10.1109/tit.2014.2387822

Related papers

Thermodynamic uncertainty relation for quantum entropy production

Domingos S. P. Salazar

In quantum thermodynamics, entropy production is usually defined in terms of the quantum relative entropy between two states. We derive a lower bound for the quantum entropy production in terms of the mean and variance of quantum observables, which we refer to as a thermodynamic uncertainty relation (TUR) for the entropy production. In the absence of coherence between the states, our result reproduces classic TURs in stochastic thermodynamics. For the derivation of the TUR, we introduce a lower bound for a quantum generalization of the χ^{2} divergence between two states and discuss its implications for stochastic and quantum thermodynamics, as well as the limiting case where it reproduces the quantum Cramér-Rao inequality.

arXiv:2404.18163•Physical review. E•Jul 11, 2024•4 citations

Continuity of Entropies via Integral Representations

Mario Berta, Ludovico Lami, Marco Tomamichel

We show that Frenkel’s integral representation of the quantum relative entropy provides a natural framework to derive continuity bounds for quantum information measures. Our main general result is a dimension-independent semi-continuity relation for the quantum relative entropy with respect to the first argument. Using it, we obtain a number of results: (1) a tight continuity relation for the conditional entropy in the case where the two states have equal marginals on the conditioning system, resolving a conjecture by Wilde in this special case; (2) a stronger version of the Fannes–Audenaert inequality on quantum entropy; (3) better estimates on the quantum capacity of approximately degradable channels; (4) an improved continuity relation for the entanglement cost; (5) general upper bounds on asymptotic transformation rates in infinite-dimensional entanglement theory; and (6) a proof of a conjecture due to Christandl, Ferrara, and Lancien on the continuity of ’filtered’ relative entropy distances.

arXiv:2408.15226•IEEE Transactions on Information Theory•Jan 9, 2025•7 citations

Quantum relative entropy uncertainty relation

Domingos S. P. Salazar

For classic systems, the thermodynamic uncertainty relation (TUR) states that the fluctuations of a current have a lower bound in terms of the entropy production. Some TURs are rooted in information theory, particularly derived from relations between observations (mean and variance) and dissimilarities, such as the Kullback-Leibler divergence, which plays the role of entropy production in stochastic thermodynamics. We generalize this idea for quantum systems, where we find a lower bound for the uncertainty of quantum observables given in terms of the quantum relative entropy. We apply the result to obtain a quantum thermodynamic uncertainty relation in terms of the quantum entropy production, valid for arbitrary dynamics and nonthermal environments.

arXiv:2309.09990•Physical review. E•Jan 19, 2024•7 citations

Quantifying coherence with quantum addition

Chiranjib Mukhopadhyay, Arun Kumar Pati, Sk Sazim

Quantum addition channels have been recently introduced in the context of deriving entropic power inequalities for finite dimensional quantum systems. We prove a reverse entropy power equality which can be used to analytically prove an inequality conjectured recently for arbitrary dimension and arbitrary addition weight. We show that the relative entropic difference between the output of such a quantum additon channel and the corresponding classical mixture quantitatively captures the amount of coherence present in a quantum system. This new coherence measure admits an upper bound in terms of the relative entropy of coherence and is utilized to formulate a state-dependent uncertainty relation for two observables. Our results may provide deep insights to the origin of quantum coherence for mixed states that truly come from the discrepancy between quantum addition and the classical mixture.

arXiv:1803.06982•Mar 19, 2018•0 citations

Continuity Bounds for Quantum Entropies Arising From a Fundamental Entropic Inequality

Koenraad M. R. Audenaert, Bjarne Bergh, Nilanjana Datta +3 more

We establish a tight upper bound for the difference in von Neumann entropies between two quantum states,$\rho _{1}$and$\rho _{2}$. This bound is expressed in terms of the von Neumann entropies of the mutually orthogonal states derived from the Jordan-Hahn decomposition of the difference operator$(\rho _{1} - \rho _{2})$. This yields a novel entropic inequality that implies the well-known Audenaert-Fannes (AF) inequality. In fact, it also leads to a refinement of the AF inequality. We employ this inequality to obtain a uniform continuity bound for the quantum conditional entropy of two states whose marginals on the conditioning system coincide. We additionally use it to derive a continuity bound for the quantum relative entropy in both variables. Interestingly, the fundamental entropic inequality is also valid in infinite dimensions.

arXiv:2408.15306•IEEE Transactions on Information Theory•Jul 8, 2025•4 citations

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

Simon Becker, Nilanjana Datta, Michael G. Jabbour

We prove a variety of improved uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality. We then employ this classical result to derive a tight energy-constrained continuity bound for the von Neumann entropy. To deal with more general entropies in infinite dimensions,e.g.$\alpha $-Rényi and$\alpha $-Tsallis entropies, we develop a novel approximation scheme based on operator Hölder continuity estimates. Finally, we settle an open problem raised by Shirokov regarding the characterisation of states with finite entropy.

arXiv:2104.02019•IEEE Transactions on Information Theory•Feb 23, 2023•16 citations
We prove a lower bound on the relative entropy between two finite-dimensional states in terms of their entropy difference and the dimension of the underlying space. The inequality is tight in the sense that equality can be attained for any prescribed value of the entropy difference, both for quantum and classical systems. We outline implications for information theory and thermodynamics, such as a necessary condition for a process to be close to thermodynamic reversibility, or an easily computable lower bound on the classical channel capacity. Furthermore, we derive a tight upper bound, uniform for all states of a given dimension, on the variance of the surprisal, whose thermodynamic meaning is that of heat capacity.
In quantum thermodynamics, entropy production is usually defined in terms of the quantum relative entropy between two states. We derive a lower bound for the quantum entropy production in terms of the mean and variance of quantum observables, which we refer to as a thermodynamic uncertainty relation (TUR) for the entropy production. In the absence of coherence between the states, our result reproduces classic TURs in stochastic thermodynamics. For the derivation of the TUR, we introduce a lower bound for a quantum generalization of the χ^{2} divergence between two states and discuss its implications for stochastic and quantum thermodynamics, as well as the limiting case where it reproduces the quantum Cramér-Rao inequality.
We show that Frenkel’s integral representation of the quantum relative entropy provides a natural framework to derive continuity bounds for quantum information measures. Our main general result is a dimension-independent semi-continuity relation for the quantum relative entropy with respect to the first argument. Using it, we obtain a number of results: (1) a tight continuity relation for the conditional entropy in the case where the two states have equal marginals on the conditioning system, resolving a conjecture by Wilde in this special case; (2) a stronger version of the Fannes–Audenaert inequality on quantum entropy; (3) better estimates on the quantum capacity of approximately degradable channels; (4) an improved continuity relation for the entanglement cost; (5) general upper bounds on asymptotic transformation rates in infinite-dimensional entanglement theory; and (6) a proof of a conjecture due to Christandl, Ferrara, and Lancien on the continuity of ’filtered’ relative entropy distances.
For classic systems, the thermodynamic uncertainty relation (TUR) states that the fluctuations of a current have a lower bound in terms of the entropy production. Some TURs are rooted in information theory, particularly derived from relations between observations (mean and variance) and dissimilarities, such as the Kullback-Leibler divergence, which plays the role of entropy production in stochastic thermodynamics. We generalize this idea for quantum systems, where we find a lower bound for the uncertainty of quantum observables given in terms of the quantum relative entropy. We apply the result to obtain a quantum thermodynamic uncertainty relation in terms of the quantum entropy production, valid for arbitrary dynamics and nonthermal environments.
Quantum addition channels have been recently introduced in the context of deriving entropic power inequalities for finite dimensional quantum systems. We prove a reverse entropy power equality which can be used to analytically prove an inequality conjectured recently for arbitrary dimension and arbitrary addition weight. We show that the relative entropic difference between the output of such a quantum additon channel and the corresponding classical mixture quantitatively captures the amount of coherence present in a quantum system. This new coherence measure admits an upper bound in terms of the relative entropy of coherence and is utilized to formulate a state-dependent uncertainty relation for two observables. Our results may provide deep insights to the origin of quantum coherence for mixed states that truly come from the discrepancy between quantum addition and the classical mixture.
We establish a tight upper bound for the difference in von Neumann entropies between two quantum states,ρ1\rho _{1}ρ1​andρ2\rho _{2}ρ2​. This bound is expressed in terms of the von Neumann entropies of the mutually orthogonal states derived from the Jordan-Hahn decomposition of the difference operator(ρ1−ρ2)(\rho _{1} - \rho _{2})(ρ1​−ρ2​). This yields a novel entropic inequality that implies the well-known Audenaert-Fannes (AF) inequality. In fact, it also leads to a refinement of the AF inequality. We employ this inequality to obtain a uniform continuity bound for the quantum conditional entropy of two states whose marginals on the conditioning system coincide. We additionally use it to derive a continuity bound for the quantum relative entropy in both variables. Interestingly, the fundamental entropic inequality is also valid in infinite dimensions.
We prove a variety of improved uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality. We then employ this classical result to derive a tight energy-constrained continuity bound for the von Neumann entropy. To deal with more general entropies in infinite dimensions,e.g.$\alpha −Reˊnyiand-Rényi and−Reˊnyiand\alpha $-Tsallis entropies, we develop a novel approximation scheme based on operator Hölder continuity estimates. Finally, we settle an open problem raised by Shirokov regarding the characterisation of states with finite entropy.