Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1605.02821 · Proceedings of the Japan Academy Series B

Finite-block-length analysis in classical and quantum information theory

Masahito HAYASHI

Published Jan 1, 2017• 9 citations
arXivHTMLPDF

Abstract

Coding technology is used in several information processing tasks. In particular, when noise during transmission disturbs communications, coding technology is employed to protect the information. However, there are two types of coding technology: coding in classical information theory and coding in quantum information theory. Although the physical media used to transmit information ultimately obey quantum mechanics, we need to choose the type of coding depending on the kind of information device, classical or quantum, that is being used. In both branches of information theory, there are many elegant theoretical results under the ideal assumption that an infinitely large system is available. In a realistic situation, we need to account for finite size effects. The present paper reviews finite size effects in classical and quantum information theory with respect to various topics, including applied aspects.

DOI
10.2183/pjab.93.007

Related papers

Quantum channels and memory effects

Filippo Caruso, Vittorio Giovannetti, Cosmo Lupo +1 more

Any physical process can be represented as a quantum channel mapping an initial state to a final state. Hence it can be characterized from the point of view of communication theory, i.e., in terms of its ability to transfer information. Quantum information provides a theoretical framework and the proper mathematical tools to accomplish this. In this context the notion of codes and communication capacities have been introduced by generalizing them from the classical Shannon theory of information transmission and error correction. The underlying assumption of this approach is to consider the channel not as acting on a single system, but on sequences of systems, which, when properly initialized allow one to overcome the noisy effects induced by the physical process under consideration. While most of the work produced so far has been focused on the case in which a given channel transformation acts identically and independently on the various elements of the sequence (memoryless configuration in jargon), correlated error models appear to be a more realistic way to approach the problem. A slightly different, yet conceptually related, notion of correlated errors applies to a single quantum system which evolves continuously in time under the influence of an external disturbance which acts on it in a non-Markovian fashion. This leads to the study of memory effects in quantum channels: a fertile ground where interesting novel phenomena emerge at the intersection of quantum information theory and other branches of physics. A survey is taken of the field of quantum channels theory while also embracing these specific and complex settings.

arXiv:1207.5435•Reviews of Modern Physics•Dec 10, 2014•329 citations

Noise in Quantum Information Processing

Christopher T. Chubb

Quantum phenomena such as superposition and entanglement imbue quantum systems with information processing power in excess of their classical counterparts. These properties of quantum states are, however, highly fragile. As we enter the era of noisy intermediate-scale quantum (NISQ) devices, this vulnerability to noise is a major hurdle to the experimental realisation of quantum technologies. In this thesis we explore the role of noise in quantum information processing from two different perspectives. In Part I we consider noise from the perspective of quantum error correcting codes. Error correcting codes are often analysed with respect to simplified toy models of noise, such as iid depolarising noise. We consider generalising these techniques for analysing codes under more realistic noise models, including features such as biased or correlated errors. We also consider designing customised codes which not only take into account and exploit features of the underlying physical noise. Considering such tailored codes will be of particular importance for NISQ applications in which finite-size effects can be significant. In Part II we apply tools from information theory to study the finite-resource effects which arise in the trade-offs between resource costs and error rates for certain quantum information processing tasks. We start by considering classical communication over quantum channels, providing a refined analysis of the trade-off between communication rate and error in the regime of a finite number of channel uses. We then extend these techniques to the problem of resource interconversion in theories such as quantum entanglement and quantum thermodynamics, studying finite-size effects which arise in resource-error trade-offs. By studying this effect in detail, we also show how detrimental finite-size effects in devices such as thermal engines may be greatly suppressed by carefully engineering the underlying resource interconversion processes.

•Feb 28, 2019•0 citations

Quantum Information Theory in Infinite Dimensions with Application to Optical Channels

Vinod Sharma, Konchady Gautam Shenoy

Abstract Information theory deals with the efficient representation of information sources as well as providing fundamental limits to the amount of information communicated reliably over channels. These sources and channels are generally classical, i.e., represented by standard probability distributions. Quantum information theory takes it to the next level where we allow for the sources as well as channels to be quantum. From the representation of quantum states to the communication over quantum channels, the theory not only essentially encapsulates classical information theoretic methods but also accounts for quantum effects such as superposition, entanglement, interference, etc. In this article, we will review and focus on the information theoretic analysis of quantum channels with infinite dimensions. Infinite dimensionality is needed to model quantum optical channels which are ubiquitous in today’s practical networks, distributed quantum communication and quantum internet. The infinite dimensionality introduces some unique problems when compared with finite-dimensional channels and has not been deeply explored in literature from the quantum information theoretic perspective. For these channels, we provide the essential concepts and state-of-the-art channel capacity results. To make this paper self-contained, we also recall the finite dimensional results.

Journal of the Indian Institute of Science•Aug 23, 2022•0 citations

Classical and Quantum Information Theory

E. Desurvire

Information theory lies at the heart of modern technology, underpinning all communications, networking, and data storage systems. This book sets out, for the first time, a complete overview of both classical and quantum information theory. Throughout, the reader is introduced to key results without becoming lost in mathematical details. Opening chapters present the basic concepts and various applications of Shannon's entropy, moving on to the core features of quantum information and quantum computing. Topics such as coding, compression, error-correction, cryptography and channel capacity are covered from classical and quantum viewpoints. Employing an informal yet scientifically accurate approach, Desurvire provides the reader with the knowledge to understand quantum gates and circuits. Highly illustrated, with numerous practical examples and end-of-chapter exercises, this text is ideal for graduate students and researchers in electrical engineering and computer science, and practitioners in the telecommunications industry. Further resources and instructor-only solutions are available at www.cambridge.org/9780521881715.

Cambridge University Press eBooks•Feb 19, 2009•105 citations

On Quantum and Classical Error Control Codes: Constructions and Applications

Salah A. Aly

It is conjectured that quantum computers are able to solve certain problems more quickly than any deterministic or probabilistic computer. A quantum computer exploits the rules of quantum mechanics to speed up computations. However, it is a formidable task to build a quantum computer, since the quantum mechanical systems storing the information unavoidably interact with their environment. Therefore, one has to mitigate the resulting noise and decoherence effects to avoid computational errors. In this work, I study various aspects of quantum error control codes -- the key component of fault-tolerant quantum information processing. I present the fundamental theory and necessary background of quantum codes and construct many families of quantum block and convolutional codes over finite fields, in addition to families of subsystem codes over symmetric and asymmetric channels. Particularly, many families of quantum BCH, RS, duadic, and convolutional codes are constructed over finite fields. Families of subsystem codes and a class of optimal MDS subsystem codes are derived over asymmetric and symmetric quantum channels. In addition, propagation rules and tables of upper bounds on subsystem code parameters are established. Classes of quantum and classical LDPC codes based on finite geometries and Latin squares are constructed.

arXiv:0812.5104•Dec 30, 2008•7 citations

Nature and location of quantum information

Robert B. Griffiths

Quantum information is defined by applying the concepts of ordinary (Shannon) information theory to a quantum sample space consisting of a single framework or consistent family. A classical analogy for a spin-half particle and other arguments show that the infinite amount of information needed to specify a precise vector in its Hilbert space is not a measure of the information carried by a quantum entity with a d-dimensional Hilbert space; the latter is, instead, bounded by ${\mathrm{log}}_{2}d$ bits (one bit per qubit). The two bits of information transmitted in dense coding are located not in one but in the correlation between two qubits, consistent with this bound. A quantum channel can be thought of as a structure or collection of frameworks, and the physical location of the information in the individual frameworks can be used to identify the location of the channel. Analysis of a quantum circuit used as a model of teleportation shows that the location of the channel depends upon which structure is employed; for ordinary teleportation it is not (contrary to Deutsch and Hayden) present in the two bits resulting from the Bell-basis measurement, but in correlations of these with a distant qubit. In neither teleportation nor dense coding does information travel backwards in time, nor is it transmitted by nonlocal (superluminal) influences. It is (tentatively) proposed that all aspects of quantum information can in principle be understood in terms of the (basically classical) behavior of information in a particular framework, along with the framework dependence of this information.

arXiv:quant-ph/0203058•Physical Review A•Jul 25, 2002•22 citations
Coding technology is used in several information processing tasks. In particular, when noise during transmission disturbs communications, coding technology is employed to protect the information. However, there are two types of coding technology: coding in classical information theory and coding in quantum information theory. Although the physical media used to transmit information ultimately obey quantum mechanics, we need to choose the type of coding depending on the kind of information device, classical or quantum, that is being used. In both branches of information theory, there are many elegant theoretical results under the ideal assumption that an infinitely large system is available. In a realistic situation, we need to account for finite size effects. The present paper reviews finite size effects in classical and quantum information theory with respect to various topics, including applied aspects.
Any physical process can be represented as a quantum channel mapping an initial state to a final state. Hence it can be characterized from the point of view of communication theory, i.e., in terms of its ability to transfer information. Quantum information provides a theoretical framework and the proper mathematical tools to accomplish this. In this context the notion of codes and communication capacities have been introduced by generalizing them from the classical Shannon theory of information transmission and error correction. The underlying assumption of this approach is to consider the channel not as acting on a single system, but on sequences of systems, which, when properly initialized allow one to overcome the noisy effects induced by the physical process under consideration. While most of the work produced so far has been focused on the case in which a given channel transformation acts identically and independently on the various elements of the sequence (memoryless configuration in jargon), correlated error models appear to be a more realistic way to approach the problem. A slightly different, yet conceptually related, notion of correlated errors applies to a single quantum system which evolves continuously in time under the influence of an external disturbance which acts on it in a non-Markovian fashion. This leads to the study of memory effects in quantum channels: a fertile ground where interesting novel phenomena emerge at the intersection of quantum information theory and other branches of physics. A survey is taken of the field of quantum channels theory while also embracing these specific and complex settings.
Quantum phenomena such as superposition and entanglement imbue quantum systems with information processing power in excess of their classical counterparts. These properties of quantum states are, however, highly fragile. As we enter the era of noisy intermediate-scale quantum (NISQ) devices, this vulnerability to noise is a major hurdle to the experimental realisation of quantum technologies. In this thesis we explore the role of noise in quantum information processing from two different perspectives. In Part I we consider noise from the perspective of quantum error correcting codes. Error correcting codes are often analysed with respect to simplified toy models of noise, such as iid depolarising noise. We consider generalising these techniques for analysing codes under more realistic noise models, including features such as biased or correlated errors. We also consider designing customised codes which not only take into account and exploit features of the underlying physical noise. Considering such tailored codes will be of particular importance for NISQ applications in which finite-size effects can be significant. In Part II we apply tools from information theory to study the finite-resource effects which arise in the trade-offs between resource costs and error rates for certain quantum information processing tasks. We start by considering classical communication over quantum channels, providing a refined analysis of the trade-off between communication rate and error in the regime of a finite number of channel uses. We then extend these techniques to the problem of resource interconversion in theories such as quantum entanglement and quantum thermodynamics, studying finite-size effects which arise in resource-error trade-offs. By studying this effect in detail, we also show how detrimental finite-size effects in devices such as thermal engines may be greatly suppressed by carefully engineering the underlying resource interconversion processes.
Abstract Information theory deals with the efficient representation of information sources as well as providing fundamental limits to the amount of information communicated reliably over channels. These sources and channels are generally classical, i.e., represented by standard probability distributions. Quantum information theory takes it to the next level where we allow for the sources as well as channels to be quantum. From the representation of quantum states to the communication over quantum channels, the theory not only essentially encapsulates classical information theoretic methods but also accounts for quantum effects such as superposition, entanglement, interference, etc. In this article, we will review and focus on the information theoretic analysis of quantum channels with infinite dimensions. Infinite dimensionality is needed to model quantum optical channels which are ubiquitous in today’s practical networks, distributed quantum communication and quantum internet. The infinite dimensionality introduces some unique problems when compared with finite-dimensional channels and has not been deeply explored in literature from the quantum information theoretic perspective. For these channels, we provide the essential concepts and state-of-the-art channel capacity results. To make this paper self-contained, we also recall the finite dimensional results.
Information theory lies at the heart of modern technology, underpinning all communications, networking, and data storage systems. This book sets out, for the first time, a complete overview of both classical and quantum information theory. Throughout, the reader is introduced to key results without becoming lost in mathematical details. Opening chapters present the basic concepts and various applications of Shannon's entropy, moving on to the core features of quantum information and quantum computing. Topics such as coding, compression, error-correction, cryptography and channel capacity are covered from classical and quantum viewpoints. Employing an informal yet scientifically accurate approach, Desurvire provides the reader with the knowledge to understand quantum gates and circuits. Highly illustrated, with numerous practical examples and end-of-chapter exercises, this text is ideal for graduate students and researchers in electrical engineering and computer science, and practitioners in the telecommunications industry. Further resources and instructor-only solutions are available at www.cambridge.org/9780521881715.
It is conjectured that quantum computers are able to solve certain problems more quickly than any deterministic or probabilistic computer. A quantum computer exploits the rules of quantum mechanics to speed up computations. However, it is a formidable task to build a quantum computer, since the quantum mechanical systems storing the information unavoidably interact with their environment. Therefore, one has to mitigate the resulting noise and decoherence effects to avoid computational errors. In this work, I study various aspects of quantum error control codes -- the key component of fault-tolerant quantum information processing. I present the fundamental theory and necessary background of quantum codes and construct many families of quantum block and convolutional codes over finite fields, in addition to families of subsystem codes over symmetric and asymmetric channels. Particularly, many families of quantum BCH, RS, duadic, and convolutional codes are constructed over finite fields. Families of subsystem codes and a class of optimal MDS subsystem codes are derived over asymmetric and symmetric quantum channels. In addition, propagation rules and tables of upper bounds on subsystem code parameters are established. Classes of quantum and classical LDPC codes based on finite geometries and Latin squares are constructed.
Quantum information is defined by applying the concepts of ordinary (Shannon) information theory to a quantum sample space consisting of a single framework or consistent family. A classical analogy for a spin-half particle and other arguments show that the infinite amount of information needed to specify a precise vector in its Hilbert space is not a measure of the information carried by a quantum entity with a d-dimensional Hilbert space; the latter is, instead, bounded by log2d{\mathrm{log}}_{2}dlog2​d bits (one bit per qubit). The two bits of information transmitted in dense coding are located not in one but in the correlation between two qubits, consistent with this bound. A quantum channel can be thought of as a structure or collection of frameworks, and the physical location of the information in the individual frameworks can be used to identify the location of the channel. Analysis of a quantum circuit used as a model of teleportation shows that the location of the channel depends upon which structure is employed; for ordinary teleportation it is not (contrary to Deutsch and Hayden) present in the two bits resulting from the Bell-basis measurement, but in correlations of these with a distant qubit. In neither teleportation nor dense coding does information travel backwards in time, nor is it transmitted by nonlocal (superluminal) influences. It is (tentatively) proposed that all aspects of quantum information can in principle be understood in terms of the (basically classical) behavior of information in a particular framework, along with the framework dependence of this information.