Analog error-correcting codes (Analog ECCs) for approximate vector-matrix multiplication have been extensively studied as means to achieve fault-tolerant in-memory computation. The theoretical foundations for such coding schemes, particularly the characterization of their correction capabilities via the height profile, have been well established in recent literature. In this paper, we focus on the case of single-error detection Analog ECCs. Among several open problems related to this case proposed by Ron M. Roth in [1], Problem 1 asks: "Identify the values of
k and
n for which every linear
[n,k] code
C over
R satisfies:
h1(C):=maxc∈C∖{0}h1(c)≥⌈n−kk⌉." Here, for any
x∈Rn,
h1(x) represents the ratio between the largest and second largest absolute values of
x's entries. As the simplest special case of Problem 1 (with
n−k=2), the following problem was posed as Problem 2 in [1]: "Must every
(n−2)-dimensional subspace of
Rn,
n even, contain a nonzero vector in which the ratio between the largest and second largest absolute values of its entries is at least
(n/2)−1?" These problems directly pertain to the lower bounds on the single-error detection threshold for Analog ECCs: Problem 1 corresponds to arbitrary
n−k and Problem 2 corresponds to
n−k=2. In this paper, we provide an affirmative answer to Problem 2 and a rigorous proof using theories related to convex optimization. Furthermore, we extend our analytical method to show that the lower bound in Problem 1 is tight for the case where
n−k divides
k. Our results fill the gap in the lower bound theory of thresholds for single-error detection in Analog ECCs.
In recent work, it has been shown that maintaining reliability in analog vector--matrix multipliers can be modeled as the following coding problem. Vectors in
Rk are encoded into codewords of a linear
[n,k,d] code
C over
R. For prescribed positive reals
δ<Δ, additive errors of magnitude at most
δ are tolerable and need no handling, yet outlying errors of magnitude greater than
Δ are to be located or detected. The trade-off between the ratio
Δ/δ and the number of outlying errors that can be handled is determined by the height profile of
C; as such, the height profile provides a finer description of the error handling capability of
C, compared to the minimum distance
d, which only determines the number of correctable errors. This work contains a further study of the notion of the height profile. Several characterizations of the height profile are presented, thereby yielding methods for computing it. The starting point is formulating this computation as an optimization problem that is solved by a set of linear programs. This, in turn, leads to a combinatorial characterization of the height profile as a maximum (or max--min) over a certain finite set of codewords of
C. Moreover, this characterization is shown to have a simple geometric interpretation when the columns of the generator matrix of
C all have the same
L2 norm. Through examples of several code families, it is demonstrated how the results herein can be used to compute the height profile explicitly.
A class of codes designed to protect function evaluations of a message from errors was introduced in “Function-Correcting Codes” by Lenz et al. 2023. They provide a graphical representation for the problem of constructing functioncorrecting codes. We use this graph to get a lower bound on the redundancy required for function correction and classical error correction. For linear functions, we show that the adjacency matrix of this graph is diagonalised by tensor powers of Discrete Fourier Transform (DFT) matrices, which leads to a lower bound on redundancy. Also, we propose a version of the sphere packing bound for linear-function correcting codes. Further more, we identify a class of linear functions for which an upper bound proposed by Lenz et al., is tight.
Two linear error-correcting codes
C1,C2⊆Fqn are called linearly equivalent if there is a linear isometry mapping
C1 to
C2. In this work, we generalize the notion of linear equivalence and study the minimum distortion
D(C1,C2) of a linear mapping between codes
C1,C2⊆Fqn, which quantifies how similar
C1 and
C2 are. We introduce and study the Code Distortion Problem (CDP), which asks to find a minimum distortion mapping between two input codes
C1 and
C2. CDP generalizes the Linear Code Equivalence Problem (LCE), which is essentially the special case of CDP where
D(C1,C2)=1 and which is well-studied because of its role in cryptography. We prove that (decisional) CDP is
NP-hard to approximate to within any constant factor, and that it is in
Σ2P. We also give a single-exponential-time
k2-approximation algorithm for CDP, where
k is the dimension of the input codes. Furthermore, we give a single-exponential-time
(32k+1)2-approximation algorithm for a natural special case of CDP, and we show that our analysis is tight in this case. We use techniques from analogous work on the Lattice Distortion Problem (LDP) by Bennett, Dadush, and Stephens-Davidowitz (ESA, 2016). We also introduce or study a number of additional concepts that might be of independent interest. These include an adaptation of the celebrated reduction of Goldreich, Micciancio, Safra, and Seifert (IPL, 1999) from the Shortest Vector Problem (SVP) to the Closest Vector Problem (CVP) on lattices to the analogous problems on codes; successive minima bases for codes; and the matrix
0→0 "norm" on subspaces.
A fundamental quantity of interest in Shannon theory, classical or quantum, is the error exponent of a given channel W and rate R: the constant
E(W,R)which governs the exponential decay of decoding error when using ever larger optimal codes of fixed rate R to communicate over ever more (memoryless) instances of a given channel W. Nearly matching lower and upper bounds are well-known for classical channels. Here I show a lower bound on the error exponent of communication over arbitrary classical-quantum (CQ) channels which matches Dalai’s sphere-packing upper bound for rates above a critical value, exactly analogous to the case of classical channels. This proves a conjecture made by Holevo in his investigation of the problem. Unlike the classical case, however, the argument does not proceed via a refined analysis of a suitable decoder, but instead by leveraging a bound by Hayashi on the error exponent of the cryptographic task of privacy amplification. This bound is then related to the coding problem via tight entropic uncertainty relations and Gallager’s method of constructing capacity-achieving parity-check codes for arbitrary channels. Along the way, I find a lower bound on the error exponent of the task of compression of classical information relative to quantum side information that matches the sphere-packing upper bound of Cheng et al. In turn, the polynomial prefactors to the sphere-packing bound found by Cheng et al. may be translated to the privacy amplification problem, sharpening a recent result by Li, Yao, and Hayashi, at least for linear randomness extractors.