Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2301.05098 · IEEE Journal on Selected Areas in Information Theory

Estimating the Sizes of Binary Error-Correcting Constrained Codes

V. Arvind Rameshwar, Navin Kashyap

Published Jan 1, 2023• 4 citations
arXivHTMLPDF

Abstract

In this paper, we study binary constrained codes that are resilient to bit-flip errors and erasures. In our first approach, we compute the sizes of constrained subcodes of linear codes. Since there exist well-known linear codes that achieve vanishing probabilities of error over the binary symmetric channel (which causes bit-flip errors) and the binary erasure channel, constrained subcodes of such linear codes are also resilient to random bit-flip errors and erasures. We employ a simple identity from the Fourier analysis of Boolean functions, which transforms the problem of counting constrained codewords of linear codes to a question about the structure of the dual code. We illustrate the utility of our method in providing explicit values or efficient algorithms for our counting problem, by showing that the Fourier transform of the indicator function of the constraint is computable, for different constraints. Our second approach is to obtain good upper bounds, using an extension of Delsarte's linear program (LP), on the largest sizes of constrained codes that can correct a fixed number of combinatorial errors or erasures. We observe that the numerical values of our LP-based upper bounds beat the generalized sphere packing bounds of Fazeli, Vardy, and Yaakobi (2015).

DOI
10.1109/jsait.2023.3279113

Related papers

On Approximation, Bounding & Exact Calculation of Block Error Probability for Random Codes

Ralf R. Müller

This paper presents a method to calculate the exact block error probability of random codes under maximum-likelihood decoding. The proposed method is applicable to a variety of channels. Particular focus is on both spherical and Gaussian random codes in additive white Gaussian noise as well as binary random codes on the binary symmetric channel. While for spherical random codes Shannon, in 1959, argued with solid angles in $N$-dimensional space, we project the problem into two dimensions and apply standard trigonometry. This simplifies the derivation and also allows for the analysis of Gaussian random codes which turn out to perform better for short blocklengths and high rates. For spherical random codes, we show how to efficiently evaluate the error probability with high precision. The difference to Shannon's sphere packing bound turns out to be small, as the Voronoi regions harden doubly-exponential in the blocklength. We show that, whenever the code contains more than three codewords, the sphere packing bound can be tightened by a new bound, that requires exactly the same effort to compute. Furthermore, we propose a very tight approximation to simplify computation of both exact error probability and the two bounds. For the binary symmetric channel, we derive an upper and a lower bound on the block error probability. The two only differ from the exact error probability, as for discrete alphabets there is a small, but nonzero probability to guess for the correct codeword, if several codewords have equal distance to the received word.

arXiv:2003.06807•Mar 15, 2020•2 citations

Estimates of the bit error probabilities for linear block codes and symmetric binary-input memoryless channels

Vladimir B. Balakirsky

A coset representation of the bit error probabilities for binary linear block codes and arbitrary symmetric memoryless channels is derived. Such a representation leads to simple upper bounds on the bit error probabilities for code components expressed via 2n code spectra, where n is the code length, and to a "bounded distance decoding" algorithm. The performance of the algorithm is illustrated for the (23,12) Golay code and a particular channel having non-binary output alphabet where it attains a sub-optimum performance.

IEEE Information Theory Workshop (ITW)•Aug 27, 2003•1 citation

A criterion for decoding on the binary symmetric channel

Anup Rao, Oscar Sprumont

We present an approach to showing that a linear code is resilient to random errors. We use this approach to obtain decoding results for both transitive and doubly transitive codes. We give three kinds of results about linear codes in general, and transitive linear codes in particular.1. We give a tight bound on the weight distribution of every transitive linear code $ C \subseteq \mathbb{F}_2^N $:$ \mathop {\Pr }\limits_{c \in C}[ \text{wt}(c) = \alpha N] \leq 2^{-(1-h(\alpha)) \mathsf{dim}(C)}. $2. We give a criterion that certifies that a linear code $ C $ can be decoded on the binary symmetric channel. Let $ K_s(x) $ denote the Krawtchouk polynomial of degree $ s $, and let $ C^\perp $ denote the dual code of $ C $. We show that bounds on $ \mathbb{E}_{c \in C^{\perp}}[ K_{\epsilon N}( \text{wt}(c))^2] $ imply that $ C $ recovers from errors on the binary symmetric channel with parameter $ \epsilon $. Weaker bounds can be used to obtain list-decoding results using similar methods. One consequence of our criterion is that whenever the weight distribution of $ C^\perp $ is sufficiently close to the binomial distribution in some interval around $ \frac{N}{2} $, $ C $ is resilient to $ \epsilon $-errors.3. We combine known estimates for the Krawtchouk polynomials with our weight bound for transitive codes, and with known weight bounds for doubly transitive codes, to obtain list-decoding results for both these families of codes. In some regimes, our bounds for doubly transitive codes achieve the information-theoretic optimal trade-off between rate and list size.

arXiv:2202.00240•Advances in Mathematics of Communications•Feb 28, 2024•5 citations

Erasure correction by low-density codes

Victor Zyablov, Pavel S. Rybin

We generalize the method for computing the number of errors correctable by a low-density parity-check (LDPC) code in a binary symmetric channel, which was proposed by V.V. Zyablov and M.S. Pinsker in 1975. This method is for the first time applied for computing the fraction of guaranteed correctable erasures for an LDPC code with a given constituent code used in an erasure channel. Unlike previously known combinatorial methods for computing the fraction of correctable erasures, this method is based on the theory of generating functions, which allows us to obtain more precise results and unify the computation method for various constituent codes of a regular LDPC code. We also show that there exist an LDPC code with a given constituent code which, when decoded with a low-complexity iterative algorithm, is capable of correcting any erasure pattern with a number of erasures that grows linearly with the code length. The number of decoding iterations, required to correct the erasures, is a logarithmic function of the code length. We make comparative analysis of various numerical results obtained by various computation methods for certain parameters of an LDPC code with a constituent single-parity-check or Hamming code.

Problems of Information Transmission•Sep 1, 2009•6 citations

Necessary conditions for good error detection

P.N. Perry

The problem of determining the error detection capabilities of linear codes where the channel is a binary symmetric channel is addressed. Necessary conditions are given on the number of codewords in an (n,k) linear code and its dual for the probability of an undetected error to be upper bounded by 2/sup -(n-k)/.>

IEEE Transactions on Information Theory•Mar 1, 1991•16 citations

On LDPC codes satisfying the (0, k) constraint

S. Babvey, S.W. McLaughlin

In this paper, we use the stochastic expectation-maximization method to illustrate how to come close to achieving the capacity of the noisy (0, k) constrained AWGN channels. We use the bit-flipping based constrained coding system proposed by Vasic to transmit (0, k) constrained LDPC codewords over an AWGN channel. In the original approach of Vasic, if the number of flipped bits is large, the message-passing decoder of LDPC codes fails to correct all the errors and the system is prone to an error floor even at high SNR values [Vasic, B et al., 2003]. We propose a flip decoder that exploits the information from the message-passing decoder to correct the flipped bits. We illustrate that the message-passing decoder and the flip decoder together correct both the channel and flip errors, and achieve rates close to the noisy (0, k) channel capacity.

IEEE International Magnetics Conference•Jan 1, 2005•0 citations
In this paper, we study binary constrained codes that are resilient to bit-flip errors and erasures. In our first approach, we compute the sizes of constrained subcodes of linear codes. Since there exist well-known linear codes that achieve vanishing probabilities of error over the binary symmetric channel (which causes bit-flip errors) and the binary erasure channel, constrained subcodes of such linear codes are also resilient to random bit-flip errors and erasures. We employ a simple identity from the Fourier analysis of Boolean functions, which transforms the problem of counting constrained codewords of linear codes to a question about the structure of the dual code. We illustrate the utility of our method in providing explicit values or efficient algorithms for our counting problem, by showing that the Fourier transform of the indicator function of the constraint is computable, for different constraints. Our second approach is to obtain good upper bounds, using an extension of Delsarte's linear program (LP), on the largest sizes of constrained codes that can correct a fixed number of combinatorial errors or erasures. We observe that the numerical values of our LP-based upper bounds beat the generalized sphere packing bounds of Fazeli, Vardy, and Yaakobi (2015).
This paper presents a method to calculate the exact block error probability of random codes under maximum-likelihood decoding. The proposed method is applicable to a variety of channels. Particular focus is on both spherical and Gaussian random codes in additive white Gaussian noise as well as binary random codes on the binary symmetric channel. While for spherical random codes Shannon, in 1959, argued with solid angles in NNN-dimensional space, we project the problem into two dimensions and apply standard trigonometry. This simplifies the derivation and also allows for the analysis of Gaussian random codes which turn out to perform better for short blocklengths and high rates. For spherical random codes, we show how to efficiently evaluate the error probability with high precision. The difference to Shannon's sphere packing bound turns out to be small, as the Voronoi regions harden doubly-exponential in the blocklength. We show that, whenever the code contains more than three codewords, the sphere packing bound can be tightened by a new bound, that requires exactly the same effort to compute. Furthermore, we propose a very tight approximation to simplify computation of both exact error probability and the two bounds. For the binary symmetric channel, we derive an upper and a lower bound on the block error probability. The two only differ from the exact error probability, as for discrete alphabets there is a small, but nonzero probability to guess for the correct codeword, if several codewords have equal distance to the received word.
A coset representation of the bit error probabilities for binary linear block codes and arbitrary symmetric memoryless channels is derived. Such a representation leads to simple upper bounds on the bit error probabilities for code components expressed via 2n code spectra, where n is the code length, and to a "bounded distance decoding" algorithm. The performance of the algorithm is illustrated for the (23,12) Golay code and a particular channel having non-binary output alphabet where it attains a sub-optimum performance.
We present an approach to showing that a linear code is resilient to random errors. We use this approach to obtain decoding results for both transitive and doubly transitive codes. We give three kinds of results about linear codes in general, and transitive linear codes in particular.1. We give a tight bound on the weight distribution of every transitive linear code $ C \subseteq \mathbb{F}_2^N ::: \mathop {\Pr }\limits_{c \in C}[ \text{wt}(c) = \alpha N] \leq 2^{-(1-h(\alpha)) \mathsf{dim}(C)}. $2. We give a criterion that certifies that a linear code $ C $ can be decoded on the binary symmetric channel. Let $ K_s(x) $ denote the Krawtchouk polynomial of degree $ s $, and let $ C^\perp $ denote the dual code of $ C $. We show that bounds on $ \mathbb{E}_{c \in C^{\perp}}[ K_{\epsilon N}( \text{wt}(c))^2] $ imply that $ C $ recovers from errors on the binary symmetric channel with parameter $ \epsilon $. Weaker bounds can be used to obtain list-decoding results using similar methods. One consequence of our criterion is that whenever the weight distribution of $ C^\perp $ is sufficiently close to the binomial distribution in some interval around $ \frac{N}{2} $, $ C $ is resilient to $ \epsilon $-errors.3. We combine known estimates for the Krawtchouk polynomials with our weight bound for transitive codes, and with known weight bounds for doubly transitive codes, to obtain list-decoding results for both these families of codes. In some regimes, our bounds for doubly transitive codes achieve the information-theoretic optimal trade-off between rate and list size.
We generalize the method for computing the number of errors correctable by a low-density parity-check (LDPC) code in a binary symmetric channel, which was proposed by V.V. Zyablov and M.S. Pinsker in 1975. This method is for the first time applied for computing the fraction of guaranteed correctable erasures for an LDPC code with a given constituent code used in an erasure channel. Unlike previously known combinatorial methods for computing the fraction of correctable erasures, this method is based on the theory of generating functions, which allows us to obtain more precise results and unify the computation method for various constituent codes of a regular LDPC code. We also show that there exist an LDPC code with a given constituent code which, when decoded with a low-complexity iterative algorithm, is capable of correcting any erasure pattern with a number of erasures that grows linearly with the code length. The number of decoding iterations, required to correct the erasures, is a logarithmic function of the code length. We make comparative analysis of various numerical results obtained by various computation methods for certain parameters of an LDPC code with a constituent single-parity-check or Hamming code.
In this paper, we use the stochastic expectation-maximization method to illustrate how to come close to achieving the capacity of the noisy (0, k) constrained AWGN channels. We use the bit-flipping based constrained coding system proposed by Vasic to transmit (0, k) constrained LDPC codewords over an AWGN channel. In the original approach of Vasic, if the number of flipped bits is large, the message-passing decoder of LDPC codes fails to correct all the errors and the system is prone to an error floor even at high SNR values [Vasic, B et al., 2003]. We propose a flip decoder that exploits the information from the message-passing decoder to correct the flipped bits. We illustrate that the message-passing decoder and the flip decoder together correct both the channel and flip errors, and achieve rates close to the noisy (0, k) channel capacity.