Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2309.03653 · IEEE Control Systems Letters

A Note on the Estimation of Von Neumann and Relative Entropy via Quantum State Observers

Mark J. Balas, Vinod P. Gehlot, Tristan D. Griffith

Published Jan 1, 2023• 1 citation
arXivHTMLPDF

Abstract

An essential quantity in quantum information theory is the von Neumann entropy which depends entirely on the quantum density operator. Once known, the density operator reveals the statistics of observables in a quantum process, and the corresponding von Neumann entropy yields the full information content. However, the state, or density operator, of a given system may be unknown. Quantum state observers have been proposed to infer the unknown state of a quantum system. In this note, we show (i) that the von Neumann entropy of the state estimate produced by our quantum state observer is exponentially convergent to that of the system’s true state, and (ii) the relative entropy between the system and observer’s state converges exponentially to zero as long as the system starts in a full-rank state.

DOI
10.1109/lcsys.2023.3342053

Related papers

Quantum Entropy and Energy States Part II

Francesco R. Ruggeri

In this note we wish to examine three ideas. First we consider the case of W(x,t)=Sum over n an exp(-iEn t) Wn(x) ((1)) (for n=0,1 as an example) and note that the von Neuman entropy is 0 for such a state. This is pointed out in (1) together with the fact that there exists a von Neumann density operator exp(-H/T) (H=Hamiltonian operator) which yields the same result as Shannon’s entropy S using P(ei) if one uses dQ/T=Sum over n en dP(en)/T = dS. It seems then that there is a contradiction if the usual von Neumann entropy is 0 yet using a density operator = exp(-H/T) yields nonzero results. A resolution is suggested in (2) which deals with information theory and we see if it applies to ((1)). Secondly, we consider the Shannon’s form P(e)ln(P(e)) in more detail. In Part I and in previous notes we argued that ln ensures that S=S1+S2 if one has two systems. We also argued that dE= Sum over n en dP(en) = TdS if dWork =0. In this note, we argue that a stronger idea may be at work, namely the idea that Eave= Sum over n en P(en/T) and TS are essentially the same function except for a function of T. This approach may be used to show that ln is the function associated with entropy. Finally, we note as in Part I that when using either the von Neumann approach or Shannon’s entropy one must know which probabilities to use. For a system with energy levels en, P(n)=P(en/T) is an immediate candidate, but there may be more probabilities in the system related to a particle jumping from one ei to another. In such a case, if one uses these probabilities and then sums over some of them leaving only P(en/T), the form of entropy changes from that of Shannon’s form. (Originally, however, Shannon’s form is used before summing.)

•Feb 23, 2022•0 citations

Quantum information I

Vlatko Vedral

Abstract Information is often considered classical in a definite state rather than in a superposition of states. It seems rather strange to consider information in superpositions. Some people would, on the basis of this argument, conclude that quantum information can never exist and we can only have access to classical information. It turns out, however, that quantum information can be quantified in the same way as classical information using Shannon's prescription. There is a unique measure (up to a constant additive or multiplicative term) of quantum information such that S (the von Neumann entropy) is purely a function of the probabilities of outcomes of measurements made on a quantum system (that is, a function of a density operator); S is a continuous function of probability; S is additive. This chapter discusses the fidelity of pure quantum states, Helstrom's discrimination, quantum data compression, entropy of observation, conditional entropy and mutual information, relative entropy, and statistical interpretation of relative entropy.

•Sep 28, 2006•0 citations

Entropy in Quantum Probability I

Dėnes Petz

The notion of entropy was introduced by Clausius in order to discuss the thermal behavior of physical systems. After the work of Clausius, Boltzmann, Gibbs and others, the beginning of the exact treatment of entropy was due to von Neumann and Shannon. Their starting point was very di erent, von Neumann was motivated by quantum mechanics and Shannon founded communication theory. The entropy of a state describing a physical system is a quantity expressing the uncertainty or randomness of the system. Shannon regarded this uncertainty attached to a physical system as the amount of information carried by the system, so that the entropy of a state can be read as the information carried by the state. His idea comes from the following consideration: If a physical system has a large uncertainty and one receives information on the system by some procedure, then the so obtained information is more valuable than that received from a system having less uncertainty. It is understood in probability theory that the notion of (Shannon or measure theoretic) entropy has successful applications in a variety of subjects because it determines the asymptotic behavior of certain probabilities in the course of independent trials. First we will discuss this phenomena for nite quantum systems. By a nite quantum system we mean an algebra of matrices which is stable under taking adjoint. (In other words, a nite quantum system is a nite dimensional C*algebra.) If A is such an algebra then there is a linear functional Tr which takes the value 1 at each minimal projection. It is "tracial " in the sense that Tr ab = Tr ba (a; b 2 A) Every functional! on A is determined by a density operator D! 2 A in the form!(a) = Tr D! a (a 2 A): The entropy S(!) of a functional! is de ned by means of its density operator as S(!) = Tr (D!): This notion was introduced by von Neumann in 1927 and we term it von Neumann's entropy or shortly entropy (cf. [1]). In fact, von Neumann de ned the entropy such

QP-PQ, quantum probability and white noise analysis•Jul 1, 1992•2 citations

Entropies of Quantum Operators

Craig S. Lent

For a quantum state undergoing unitary Schrodinger time evolution, the von Neumann entropy is constant. Yet the second law of thermodynamics, and our experience, show that entropy increases with time. Ingarden introduced the quantum operator entropy, which is the Shannon entropy of the probability distribution for the eigenvalues of a Hermitian operator. These entropies characterize the missing information about a particular observable inherent in the quantum state itself. The von Neumann entropy is the quantum operator entropy for the case when the operator is the density matrix. We examine pure state unitary evolution in a simple model system comprised of a set of highly-interconnected topologically disordered states and a time-independent Hamiltonian. An initially confined state is subject to free expansion into available states. The time development is completely reversible with no loss of quantum information and no course graining is applied. The positional entropy increases in time in a way that is consistent with both the classical statistical mechanical entropy and the second law.

•Jan 25, 2019•0 citations

Lower bound for accessible information in quantum mechanics

Richard Jozsa, Daniel Robb, William K. Wootters

It has long been known that the von Neumann entropy S is an upper bound on the information one can extract from a quantum system in an unknown pure state. In this paper we define the ``subentropy'' Q, which we prove to be a lower bound on this information. Moreover, just as the von Neumann entropy is the best upper bound that depends only on the density matrix, we show that Q is the best lower bound that depends only on the density matrix. Other parallels between S and Q are also demonstrated.

Physical Review A•Feb 1, 1994•159 citations

Quantum operator entropies under unitary evolution

Craig S. Lent

For a quantum state undergoing unitary Schrödinger time evolution, the von Neumann entropy is constant. Yet the second law of thermodynamics, and our experience, show that entropy increases with time. Ingarden introduced the quantum operator entropy, which is the Shannon entropy of the probability distribution for the eigenvalues of a Hermitian operator [R. S. Ingarden, Quantum information theory, Rep. Math. Phys. 10, 43 (1976)RMHPBE0034-487710.1016/0034-4877(76)90005-7]. These entropies characterize the missing information about a particular observable inherent in the quantum state itself. The von Neumann entropy is the quantum operator entropy for the case when the operator is the density matrix. We examine pure state unitary evolution in a simple model system composed of a set of highly interconnected topologically disordered states and a time-independent Hamiltonian. An initially confined state is subject to free expansion into available states. The time development is completely reversible with no loss of quantum information and no course graining is applied. The positional entropy increases in time in a way that is consistent with both the classical statistical mechanical entropy and the second law.

arXiv:1901.08956•Physical review. E•Jul 2, 2019•18 citations
An essential quantity in quantum information theory is the von Neumann entropy which depends entirely on the quantum density operator. Once known, the density operator reveals the statistics of observables in a quantum process, and the corresponding von Neumann entropy yields the full information content. However, the state, or density operator, of a given system may be unknown. Quantum state observers have been proposed to infer the unknown state of a quantum system. In this note, we show (i) that the von Neumann entropy of the state estimate produced by our quantum state observer is exponentially convergent to that of the system’s true state, and (ii) the relative entropy between the system and observer’s state converges exponentially to zero as long as the system starts in a full-rank state.
In this note we wish to examine three ideas. First we consider the case of W(x,t)=Sum over n an exp(-iEn t) Wn(x) ((1)) (for n=0,1 as an example) and note that the von Neuman entropy is 0 for such a state. This is pointed out in (1) together with the fact that there exists a von Neumann density operator exp(-H/T) (H=Hamiltonian operator) which yields the same result as Shannon’s entropy S using P(ei) if one uses dQ/T=Sum over n en dP(en)/T = dS. It seems then that there is a contradiction if the usual von Neumann entropy is 0 yet using a density operator = exp(-H/T) yields nonzero results. A resolution is suggested in (2) which deals with information theory and we see if it applies to ((1)). Secondly, we consider the Shannon’s form P(e)ln(P(e)) in more detail. In Part I and in previous notes we argued that ln ensures that S=S1+S2 if one has two systems. We also argued that dE= Sum over n en dP(en) = TdS if dWork =0. In this note, we argue that a stronger idea may be at work, namely the idea that Eave= Sum over n en P(en/T) and TS are essentially the same function except for a function of T. This approach may be used to show that ln is the function associated with entropy. Finally, we note as in Part I that when using either the von Neumann approach or Shannon’s entropy one must know which probabilities to use. For a system with energy levels en, P(n)=P(en/T) is an immediate candidate, but there may be more probabilities in the system related to a particle jumping from one ei to another. In such a case, if one uses these probabilities and then sums over some of them leaving only P(en/T), the form of entropy changes from that of Shannon’s form. (Originally, however, Shannon’s form is used before summing.)
Abstract Information is often considered classical in a definite state rather than in a superposition of states. It seems rather strange to consider information in superpositions. Some people would, on the basis of this argument, conclude that quantum information can never exist and we can only have access to classical information. It turns out, however, that quantum information can be quantified in the same way as classical information using Shannon's prescription. There is a unique measure (up to a constant additive or multiplicative term) of quantum information such that S (the von Neumann entropy) is purely a function of the probabilities of outcomes of measurements made on a quantum system (that is, a function of a density operator); S is a continuous function of probability; S is additive. This chapter discusses the fidelity of pure quantum states, Helstrom's discrimination, quantum data compression, entropy of observation, conditional entropy and mutual information, relative entropy, and statistical interpretation of relative entropy.
The notion of entropy was introduced by Clausius in order to discuss the thermal behavior of physical systems. After the work of Clausius, Boltzmann, Gibbs and others, the beginning of the exact treatment of entropy was due to von Neumann and Shannon. Their starting point was very di erent, von Neumann was motivated by quantum mechanics and Shannon founded communication theory. The entropy of a state describing a physical system is a quantity expressing the uncertainty or randomness of the system. Shannon regarded this uncertainty attached to a physical system as the amount of information carried by the system, so that the entropy of a state can be read as the information carried by the state. His idea comes from the following consideration: If a physical system has a large uncertainty and one receives information on the system by some procedure, then the so obtained information is more valuable than that received from a system having less uncertainty. It is understood in probability theory that the notion of (Shannon or measure theoretic) entropy has successful applications in a variety of subjects because it determines the asymptotic behavior of certain probabilities in the course of independent trials. First we will discuss this phenomena for nite quantum systems. By a nite quantum system we mean an algebra of matrices which is stable under taking adjoint. (In other words, a nite quantum system is a nite dimensional C*algebra.) If A is such an algebra then there is a linear functional Tr which takes the value 1 at each minimal projection. It is "tracial " in the sense that Tr ab = Tr ba (a; b 2 A) Every functional! on A is determined by a density operator D! 2 A in the form!(a) = Tr D! a (a 2 A): The entropy S(!) of a functional! is de ned by means of its density operator as S(!) = Tr (D!): This notion was introduced by von Neumann in 1927 and we term it von Neumann's entropy or shortly entropy (cf. [1]). In fact, von Neumann de ned the entropy such
For a quantum state undergoing unitary Schrodinger time evolution, the von Neumann entropy is constant. Yet the second law of thermodynamics, and our experience, show that entropy increases with time. Ingarden introduced the quantum operator entropy, which is the Shannon entropy of the probability distribution for the eigenvalues of a Hermitian operator. These entropies characterize the missing information about a particular observable inherent in the quantum state itself. The von Neumann entropy is the quantum operator entropy for the case when the operator is the density matrix. We examine pure state unitary evolution in a simple model system comprised of a set of highly-interconnected topologically disordered states and a time-independent Hamiltonian. An initially confined state is subject to free expansion into available states. The time development is completely reversible with no loss of quantum information and no course graining is applied. The positional entropy increases in time in a way that is consistent with both the classical statistical mechanical entropy and the second law.
It has long been known that the von Neumann entropy S is an upper bound on the information one can extract from a quantum system in an unknown pure state. In this paper we define the ``subentropy'' Q, which we prove to be a lower bound on this information. Moreover, just as the von Neumann entropy is the best upper bound that depends only on the density matrix, we show that Q is the best lower bound that depends only on the density matrix. Other parallels between S and Q are also demonstrated.
For a quantum state undergoing unitary Schrödinger time evolution, the von Neumann entropy is constant. Yet the second law of thermodynamics, and our experience, show that entropy increases with time. Ingarden introduced the quantum operator entropy, which is the Shannon entropy of the probability distribution for the eigenvalues of a Hermitian operator [R. S. Ingarden, Quantum information theory, Rep. Math. Phys. 10, 43 (1976)RMHPBE0034-487710.1016/0034-4877(76)90005-7]. These entropies characterize the missing information about a particular observable inherent in the quantum state itself. The von Neumann entropy is the quantum operator entropy for the case when the operator is the density matrix. We examine pure state unitary evolution in a simple model system composed of a set of highly interconnected topologically disordered states and a time-independent Hamiltonian. An initially confined state is subject to free expansion into available states. The time development is completely reversible with no loss of quantum information and no course graining is applied. The positional entropy increases in time in a way that is consistent with both the classical statistical mechanical entropy and the second law.