Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:quant-ph/9612043

Asymptotic Redundancies for Universal Quantum Coding

Christian Krattenthaler, Paul B. Slater

Published Dec 18, 1996• 2 citations
arXivHTMLPDF

Abstract

We investigate the question of whether or not there exists a noncommutative/ quantum extension of a recent (commutative probabilistic) result of Clarke and Barron. They demonstrated that the Jeffreys' invariant prior of Bayesian theory yields the common asymptotic (minimax and maximin) redundancy - the excess of the encoding cost over the source entropy - of universal data compression in a parametric setting. We study certain probability distributions for the two-level quantum systems. We are able to compute exact formulas for the corresponding redundancies, for which we find the asymptotic limits. These results are very suggestive and do indeed point towards a possible quantum extension of the result of Clarke and Barron.

DOI
10.48550/arxiv.quant-ph/9612043

Related papers

Asymptotic redundancies for universal quantum coding

Christian Krattenthaler, Paul B. Slater

Clarke and Barren (1990, 1994, 1995) have shown that the Jeffreys' invariant prior of Bayesian theory yields the common asymptotic (minimax and maximin) redundancy of universal data compression in a parametric setting. We seek a possible analog of this result for the two-level quantum systems. We restrict our considerations to prior probability distributions belonging to a certain one-parameter family, q/sub u/,-/spl infin/<u<1. Within this setting, we are able to compute exact redundancy formulas, for which we find the asymptotic limits. We compare our quantum asymptotic redundancy formulas to those derived by naively applying the (nonquantum) counterparts of Clarke and Barren, and find certain common features. Our results are based on formulas we obtain for the eigenvalues and eigenvectors of 2/sup n//spl times/2/sup n/ (Bayesian density) matrices, /spl zeta//sub n/(u). These matrices are the weighted averages (with respect to q/sub u/) of all possible tensor products of n identical 2/spl times/2 density matrices, representing the two-level quantum systems. We propose a form of universal coding for the situation in which the density matrix describing an ensemble of quantum signal states is unknown. A sequence of n signals would be projected onto the dominant eigenspaces of /spl zeta//sub n/(u).

arXiv:math/9705212•IEEE Transactions on Information Theory•May 1, 2000•22 citations

The quantum Jeffreys' prior/Bures metric volume element for squeezed thermal states and a universal coding conjecture

Paul B. Slater

Clarke and Barron have recently established that the (classical) Jeffreys' prior yields universal codes - ones which do relatively well (in the sense of relative entropy) no matter what the true state. Twamley has recently computed the Bures metric - proportional to the quantum Fisher information (statistical distinguishability) metric, as shown by Braunstein and Caves - for squeezed thermal states. The volume elements of these metrics - that is, the quantum Jeffreys' prior - are found to be simply the product of a function of the squeeze factor and a function of the inverse temperature, the phase being irrelevant in this regard. A computational strategy to find a universal coding using the quantum Jeffreys' prior - previously implemented for the two-level quantum systems - is then discussed.

Journal of Physics A Mathematical and General•Dec 7, 1996•18 citations

Aspects of Quantum Information Compression for Pure States

Richard Jozsa

Consider a source of pure quantum states with density matrix ρ and von Neumann entropy S . It is known that the quantum information of the source may be faithfully compressed to 5 qubits/signal (asymptotically for long sequences) and that this limit is optimal if we demand high fidelity for long strings of signals. The usual method for achieving this compression, based on the typical subspace of the source, requires knowledge of the density matrix. We describe a new “universal” compression scheme which does not even require knowledge of ρ. More precisely, suppose that the source is known to have von Neumann entropy less than some given bound S 0 but is otherwise completely unspecified. Our method will faithfully compress the quantum information of any such source to S 0 qubits/signal. It is known that S is always less than or equal to the Shannon entropy H of the prior distribution of the source. According to Shannon’s theorem, H provides the limit for compression of classical signals, so one may ask the question: what is the physical origin of the extra compression available in the quantum case compared to the classical case (where the prior probabilities are the same)? One may suggest that this effect is a consequence of possible non-orthogonality of signal states. However we demonstrate that it is possible to make each pair of signal states of a source more parallel (keeping the prior probabilities the same) while increasing the von Neumann entropy. This casts doubt on the conventional wisdom that overlap of quantum states is a measure of their (non-)distinguishability. These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Kluwer Academic Publishers eBooks•Dec 19, 2005•1 citation

Optimal lower bound for lossless quantum block encoding

George Androulakis, Rabins Wosti

Consider a general quantum stochastic source that emits at discrete time steps quantum pure states which are chosen from a finite alphabet according to some probability distribution which may depend on the whole history. Also, fix two positive integers $m$ and $l$. We encode any tensor product of $m$ many states emitted by the quantum stochastic source by breaking the tensor product into $m$ many blocks where each block has length $l$, and considering sequences of $m$ many isometries so that each isometry encodes one of these blocks into the Fock space, followed by the concatenation of their images. We only consider certain sequences of such isometries that we call \lq\lq special block codes\rq\rq\ in order to ensure that the string of encoded states is uniquely decodable. We compute the minimum average codeword length of these encodings which depends on the quantum source and the integers $m$, $l$, among all possible special block codes. Our result extends the result of [Bellomo, Bosyk, Holik and Zozor, Scientific Reports 7.1 (2017): 14765] where the minimum was computed for one block, i.e.\ for $m=1$. Lastly, we give a simplified non-adaptive compression technique based on constrained special block codes for general quantum stochastic sources. For quantum stationary sources in particular, we show that the minimum average codeword length per symbol computed over all constrained special block codes is equal to the von-Neumann entropy rate of the source for an asymptotically long block size.

arXiv:2305.18748•Quantum Information and Computation•Nov 1, 2024•0 citations

Lower Bound on Expected Communication Cost of Quantum Huffman Coding

Anurag Anshu, Ankit Garg, Aram W. Harrow +1 more

Data compression is a fundamental problem in quantum and classical information theory. A typical version of the problem is that the sender Alice receives a (classical or quantum) state from some known ensemble and needs to transmit them to the receiver Bob with average error below some specified bound. We consider the case in which the message can have a variable length and the goal is to minimize its expected length. For classical messages this problem has a well-known solution given by Huffman coding. In this scheme, the expected length of the message is equal to the Shannon entropy of the source (with a constant additive factor) and the scheme succeeds with zero error. This is a single-shot result which implies the asymptotic result, viz. Shannon's source coding theorem, by encoding each state sequentially. For the quantum case, the asymptotic compression rate is given by the von-Neumann entropy. However, we show that there is no one-shot scheme which is able to match this rate, even if interactive communication is allowed. This is a relatively rare case in quantum information theory when the cost of a quantum task is significantly different than the classical analogue. Our result has implications for direct sum theorems in quantum communication complexity and one-shot formulations of Quantum Reverse Shannon theorem.

Leibniz international proceedings in informatics•Jan 1, 2016•0 citations

Universal quantum information compression and degrees of prior knowledge

Richard Jozsa, Stuart Presnell

We describe a universal information–compression scheme that compresses any pure quantum independent identically distributed (i.i.d.) source asymptotically to its von Neumann entropy, with no prior knowledge of the structure of the source. We introduce a diagonalization procedure that enables any classical compression algorithm to be used in a quantum context. Our scheme is then based on the corresponding quantum translation of the classical Lempel–Ziv algorithm. Our methods lead to a conceptually simple way of estimating the entropy of a source in terms of the measurement of an associated length parameter while maintaining high fidelity for long blocks. As a byproduct we also estimate the eigenbasis of the source. Since our scheme is based on the Lempel–Ziv method, it can potentially be applied also to non–i.i.d. sources that satisfy some further regularity conditions.

arXiv:quant-ph/0210196•Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences•Nov 25, 2003•30 citations
We investigate the question of whether or not there exists a noncommutative/ quantum extension of a recent (commutative probabilistic) result of Clarke and Barron. They demonstrated that the Jeffreys' invariant prior of Bayesian theory yields the common asymptotic (minimax and maximin) redundancy - the excess of the encoding cost over the source entropy - of universal data compression in a parametric setting. We study certain probability distributions for the two-level quantum systems. We are able to compute exact formulas for the corresponding redundancies, for which we find the asymptotic limits. These results are very suggestive and do indeed point towards a possible quantum extension of the result of Clarke and Barron.
Clarke and Barren (1990, 1994, 1995) have shown that the Jeffreys' invariant prior of Bayesian theory yields the common asymptotic (minimax and maximin) redundancy of universal data compression in a parametric setting. We seek a possible analog of this result for the two-level quantum systems. We restrict our considerations to prior probability distributions belonging to a certain one-parameter family, q/sub u/,-/spl infin/<u<1. Within this setting, we are able to compute exact redundancy formulas, for which we find the asymptotic limits. We compare our quantum asymptotic redundancy formulas to those derived by naively applying the (nonquantum) counterparts of Clarke and Barren, and find certain common features. Our results are based on formulas we obtain for the eigenvalues and eigenvectors of 2/sup n//spl times/2/sup n/ (Bayesian density) matrices, /spl zeta//sub n/(u). These matrices are the weighted averages (with respect to q/sub u/) of all possible tensor products of n identical 2/spl times/2 density matrices, representing the two-level quantum systems. We propose a form of universal coding for the situation in which the density matrix describing an ensemble of quantum signal states is unknown. A sequence of n signals would be projected onto the dominant eigenspaces of /spl zeta//sub n/(u).
Clarke and Barron have recently established that the (classical) Jeffreys' prior yields universal codes - ones which do relatively well (in the sense of relative entropy) no matter what the true state. Twamley has recently computed the Bures metric - proportional to the quantum Fisher information (statistical distinguishability) metric, as shown by Braunstein and Caves - for squeezed thermal states. The volume elements of these metrics - that is, the quantum Jeffreys' prior - are found to be simply the product of a function of the squeeze factor and a function of the inverse temperature, the phase being irrelevant in this regard. A computational strategy to find a universal coding using the quantum Jeffreys' prior - previously implemented for the two-level quantum systems - is then discussed.
Consider a source of pure quantum states with density matrix ρ and von Neumann entropy S . It is known that the quantum information of the source may be faithfully compressed to 5 qubits/signal (asymptotically for long sequences) and that this limit is optimal if we demand high fidelity for long strings of signals. The usual method for achieving this compression, based on the typical subspace of the source, requires knowledge of the density matrix. We describe a new “universal” compression scheme which does not even require knowledge of ρ. More precisely, suppose that the source is known to have von Neumann entropy less than some given bound S 0 but is otherwise completely unspecified. Our method will faithfully compress the quantum information of any such source to S 0 qubits/signal. It is known that S is always less than or equal to the Shannon entropy H of the prior distribution of the source. According to Shannon’s theorem, H provides the limit for compression of classical signals, so one may ask the question: what is the physical origin of the extra compression available in the quantum case compared to the classical case (where the prior probabilities are the same)? One may suggest that this effect is a consequence of possible non-orthogonality of signal states. However we demonstrate that it is possible to make each pair of signal states of a source more parallel (keeping the prior probabilities the same) while increasing the von Neumann entropy. This casts doubt on the conventional wisdom that overlap of quantum states is a measure of their (non-)distinguishability. These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Consider a general quantum stochastic source that emits at discrete time steps quantum pure states which are chosen from a finite alphabet according to some probability distribution which may depend on the whole history. Also, fix two positive integers mmm and lll. We encode any tensor product of mmm many states emitted by the quantum stochastic source by breaking the tensor product into mmm many blocks where each block has length lll, and considering sequences of mmm many isometries so that each isometry encodes one of these blocks into the Fock space, followed by the concatenation of their images. We only consider certain sequences of such isometries that we call \lq\lq special block codes\rq\rq\ in order to ensure that the string of encoded states is uniquely decodable. We compute the minimum average codeword length of these encodings which depends on the quantum source and the integers mmm, lll, among all possible special block codes. Our result extends the result of [Bellomo, Bosyk, Holik and Zozor, Scientific Reports 7.1 (2017): 14765] where the minimum was computed for one block, i.e.\ for m=1m=1m=1. Lastly, we give a simplified non-adaptive compression technique based on constrained special block codes for general quantum stochastic sources. For quantum stationary sources in particular, we show that the minimum average codeword length per symbol computed over all constrained special block codes is equal to the von-Neumann entropy rate of the source for an asymptotically long block size.
Data compression is a fundamental problem in quantum and classical information theory. A typical version of the problem is that the sender Alice receives a (classical or quantum) state from some known ensemble and needs to transmit them to the receiver Bob with average error below some specified bound. We consider the case in which the message can have a variable length and the goal is to minimize its expected length. For classical messages this problem has a well-known solution given by Huffman coding. In this scheme, the expected length of the message is equal to the Shannon entropy of the source (with a constant additive factor) and the scheme succeeds with zero error. This is a single-shot result which implies the asymptotic result, viz. Shannon's source coding theorem, by encoding each state sequentially. For the quantum case, the asymptotic compression rate is given by the von-Neumann entropy. However, we show that there is no one-shot scheme which is able to match this rate, even if interactive communication is allowed. This is a relatively rare case in quantum information theory when the cost of a quantum task is significantly different than the classical analogue. Our result has implications for direct sum theorems in quantum communication complexity and one-shot formulations of Quantum Reverse Shannon theorem.
We describe a universal information–compression scheme that compresses any pure quantum independent identically distributed (i.i.d.) source asymptotically to its von Neumann entropy, with no prior knowledge of the structure of the source. We introduce a diagonalization procedure that enables any classical compression algorithm to be used in a quantum context. Our scheme is then based on the corresponding quantum translation of the classical Lempel–Ziv algorithm. Our methods lead to a conceptually simple way of estimating the entropy of a source in terms of the measurement of an associated length parameter while maintaining high fidelity for long blocks. As a byproduct we also estimate the eigenbasis of the source. Since our scheme is based on the Lempel–Ziv method, it can potentially be applied also to non–i.i.d. sources that satisfy some further regularity conditions.