Concepts and methods for benchmarking quantum computers

Kristine Boone

Published Jul 9, 2021• 0 citations

Abstract

Quantum computers have the potential to bring about a new age of technology, but in order for them to become a reality, the elephant in the room must be addressed, quantum errors. The complexity of quantum errors grows exponentially as the system size is increased; scalable characterization protocols which work under physically realistic noise are therefore needed to assess and optimize control. \n \nRandomized Benchmarking (RB) is a family of characterization protocols with the requisite qualities. RB protocols are independent of state preparation and measurement (SPAM) errors, and because they extract partial information about the error profiles in the form of figures of merit, they are scalable in the number of qubits. In this thesis, we study these figures of merit under various error models, gate-sets, and sample distributions, to further our understanding of their physical meaning, and to fine-tune the best practice for diagnosing errors in basic gate-sets. \n \nThe first study presented in this thesis looks at the physical meaning of the unitarity under physically realistic gate-dependent noise. Numerically, we demonstrate that under these realistic noise models, the unitarity obtained via Extended RB (XRB) overlaps strongly with the average of the unitarity of the errors over the set of individual operations. \n \nThe second study numerically and analytically proves that the Standard RB (SRB) decay parameter p coincides with the decay parameter of the novel figure of merit gate-set circuit fidelity. We also prove that, in the limit of high-fidelity single-qubit experiments, the disconnect between the average gate fidelity and SRB experimental results is caused by a basis mismatch between the gates and the state-preparation and measurement procedures. \n \nIn the third part of this thesis, we compare the results of two variations of the SRB protocol, one that samples uniformly (SRB) and one that samples non-uniformly (NIST RB) from the Clifford group. We prove that NIST RB produces an exponential fidelity curve that gives different infidelity results than SRB. \n \nThe fourth and final study gives a standard for assessing basic gate-sets. Experimental results are given from the assessment run on super-conducting and ion-trap devices. We also experimentally show how the systematic error bounds can be tightened by accounting for the error's degree of coherence, as well as using weaker randomizing sets.

Related papers

A walk through quantum noise: a study of error signatures and characterization methods

Arnaud Carignan-Dugas

The construction of large scale quantum computing devices might be one of the most exciting \nand promising endeavors of the 21st century, but it also comes with many challenges. \nAs quantum computers are supplemented with more registers, their error profile generally \ngrows in complexity, rendering the enterprise of quantifying the reliability of quantum computations \nincreasingly difficult through naive characterization techniques. In the last decade, \na lot of efforts has been directed toward developing highly scalable benchmarking schemes. \nA leading family of characterization methods built upon scalable principles is known as randomized \nbenchmarking (RB). \nIn this thesis, many tools are presented with the objective of improving the scalability, \nand versatility of RB techniques, as well as demonstrating their reliability under various \nerror models. \nThe first part of this work investigates the connection between the error of individual \ncircuit components and the error of their composition. Before reasoning about intricate circuit \nconstructions, it is shown that there exists a well-motivated way to define decoherent \nquantum channels, and that every channel can be factorized into a unitary-decoherent composition. \nThis dichotomy carries to the circuit evolution of important error parameters by \nassuming realistic error scenarios. Those results are used to improve the confidence interval \nof RB diagnoses and to reconcile experimentally estimated parameters with physically and \noperationally meaningful quantities. \nIn the second part of this thesis, various RB schemes are either developed or more rigorously \nanalyzed. A first result consists of the introduction of “dihedral benchmarking”, a \ntechnique which, if performed in conjunction with standard RB protocols, enables the characterization \nof operations that form a universal gate-set. Finally, rigorous analysis tools are \nprovided to demonstrate the reliability of a highly scalable family of generator-based RB \nprotocols known as direct RB.

Sep 17, 20190 citations

From randomized benchmarking experiments to gate-set circuit fidelity: how to interpret randomized benchmarking decay parameters

Arnaud Carignan-Dugas, Kristine Boone, Joel J. Wallman +1 more

Randomized benchmarking (RB) protocols have become an essential tool for providing a meaningful partial characterization of experimental quantum operations. While the RB decay rate is known to enable estimates of the average fidelity of those operations under gate-independent Markovian noise, under gate-dependent noise this rate is more difficult to interpret rigorously. In this paper, we prove that single-qubit RB decay parameter p coincides with the decay parameter of the gate-set circuit fidelity , a novel figure of merit which characterizes the expected average fidelity over arbitrary circuits of operations from the gate-set. We also prove that, in the limit of high-fidelity single-qubit experiments, the possible alarming disconnect between the average gate fidelity and RB experimental results is simply explained by a basis mismatch between the gates and the state-preparation and measurement procedures, that is, to a unitary degree of freedom in labeling the Pauli matrices. Based on numerical evidence and physically motivated arguments, we conjecture that these results also hold for higher dimensions.

arXiv:1804.01122New Journal of PhysicsAug 24, 201832 citations

Quantum information in the real world: Diagnosing and correcting errors in practical quantum devices

Jonas Helsen

Quantum computers promise to be a revolutionary new technology. However, in order to realise this promise many hurdles must first be overcome. In this thesis we investigate two such hurdles: the presence of noise in quantum computers and limitations on the connectivity and control in large scale quantum computing architectures.In order to combat noise in quantum devices we must first characterize this noise. To do this several diagnostic tools have been developed over the last two decades. The current industry standard for such a diagnostic tool is called randomized benchmarking. Randomized benchmarking doesn't give a full characterization of the noise afflicting the quantum device but rather attempts to give some indication of of the device's average behavior, captured in a quantity called the average fidelity. Because it does not endeavor to characterize every small detail of the noise it can be efficiently applied even to very large quantum devices. However, with this power also comes increased complexity. Randomized benchmarking has a lot of moving parts, and some fairly strong assumptions must be made in order to guarantee its correctness. In this thesis we attempt to justify these assumptions and if possible remove or weaken them, making randomized benchmarking a more robust and general tool. In chapter 6 of this thesis we investigate the finite statistics of randomized benchmarking. We prove strong bounds on the number of samples needed to perform rigorous randomized benchmarking. To do this we make use tools from representation theory. In particular we use a characterization of certain representations of the Clifford group, which we develop in chapter 5. In chapter 7 we re-use these tools to also bound the number of samples needed to perform rigorous unitarity randomized benchmarking, a newer variant of randomized benchmarking quickly gaining in popularity. These results retroactively justify the use of randomized benchmarking in an experimental setting and also provide guidance on optimal statistical practices in the context of randomized benchmarking. In chapter 8 we expand upon the standard randomized benchmarking protocol and formulate a new class of protocols which we call character randomized benchmarking. This new class of protocols removes a critical assumption made in standard randomized benchmarking, making character randomized benchmarking vastly more generally applicable. To show the advantages of character randomized benchmarking we implement it in an experiment characterizing the noise in a Si/SiGe quantum dot device. This experiment is detailed in chapter 9. Finally we deal with the second main topic of this thesis in chapter 10. Large scale quantum computer will, like classical computers, face limitations in the connectivity between different parts of the computer. This is due to a fundamental law in computer design called Rent's rule, which states that the number of wires connecting a (quantum) computer chip to the outside world is much smaller than the number of components in that chip. This means the individual components of the chip can not be controlled individually in parallel. Given that parallelism is absolutely critical for the functioning of quantum computers this is a serious problem for the development of large scale quantum computers. Luckily it is possible to organize quantum computing devices in such a way that they can be controlled using a relatively small amount of input wires. One example of such an organization is called a crossbar architecture. Recently a proposal was made for a crossbar architecture quantum computer in quantum dots, and in chapter 10 of this thesis we investigate in detail the advantages and disadvantages of such an architecture. We focus in particular on its effect on standard quantum error correction procedures, a key part of a functioning quantum computer, and one where parallel control of all parts of the quantum device is essential.

May 14, 20191 citation

From Randomized Benchmarking Experiments to Gateset Circuit Fidelity

Arnaud Carignan-Dugas, Kristine Boone, Joel J. Wallman +1 more

Randomized benchmarking (RB) protocols have become an essential tool for providing a meaningful partial characterization of experimental quantum operations. While the RB decay rate is known to enable estimates of the average fidelity of those operations under gate-independent Markovian noise, under gate-dependent noise this rate is more difficult to interpret rigorously. In this paper, we prove that single-qubit RB experiments provide direct estimates of the gateset circuit fidelity, a novel figure of merit which characterizes the expected average fidelity over arbitrary circuits of operations from the gateset. We also prove that, in the limit of high-fidelity single-qubit experiments, the difficulty introduced by gate-dependence reduces to a basis mismatch between the gates and the state-preparation and measurement procedures, that is, to a unitary degree of freedom in labeling the Pauli matrices. Based on numerical evidence and physically motivated arguments, we conjecture that these result hold for higher dimensions.

Apr 3, 20180 citations

Randomized benchmarking under different gate sets

Kristine Boone, Arnaud Carignan-Dugas, Joel J. Wallman +1 more

We provide a comprehensive analysis of the differences between two important standards for randomized benchmarking (RB): the Clifford-group RB protocol proposed originally in Emerson et al. [J. Opt. B 7, S347 (2005)] and Dankert et al. [Phys. Rev. A 80, 012304 (2009)], and a variant of that RB protocol proposed by the NIST group in Knill et al. [Phys. Rev. A 77, 012307 (2008)]. While these two protocols are frequently conflated or presumed equivalent, we prove that they produce distinct exponential fidelity decays leading to differences of up to a factor of 3 in the estimated error rates under experimentally realistic conditions. These differences arise because the NIST RB protocol does not satisfy the unitary two-design condition for the twirl in the Clifford-group protocol and thus the decay rate depends on noninvariant features of the error model. Our analysis provides an important first step toward developing definitive standards for benchmarking quantum gates and a more rigorous theoretical underpinning for the NIST protocol and other RB protocols lacking a group-structure. We conclude by discussing the potential impact of these differences for estimating fault-tolerant overheads.

arXiv:1811.01920Physical Review AMar 20, 201919 citations

Scalable randomised benchmarking of non-Clifford gates

Andrew W. Cross, Easwar Magesan, Lev S. Bishop +2 more

Randomised benchmarking is a widely used experimental technique to characterise the average error of quantum operations. Benchmarking procedures that scale to enable the characterisation of n-qubit circuits rely on efficient procedures for manipulating those circuits and, as such, have been limited to subgroups of the Clifford group. However, universal quantum computers require additional, non-Clifford gates to approximate arbitrary unitary transformations. We define a scalable randomised benchmarking procedure over n-qubit unitary matrices that correspond to protected non-Clifford gates for a class of stabiliser codes. We present efficient methods for representing and composing group elements, sampling them uniformly and synthesising corresponding poly(n)-sized circuits. The procedure provides experimental access to two independent parameters that together characterise the average gate fidelity of a group element. A scalable procedure to determine the error of quantum operations has been developed by researchers in the United States. Andrew Cross and colleagues at the IBM T.J. Watson Research Center have expanded previously used protocols to a broader range of quantum circuits, thereby enabling error benchmarking for all common logical operations used in leading quantum computing protocols. The standard technique for error characterization in these devices is randomized benchmarking, which provides benefits such as insensitivity to measurement errors, but on the other hand only functions in a limited number of circumstances. In their theoretical study, the researchers demonstrate how randomized benchmarking approaches can be expanded to a much broader range of logical operations. The procedure can be readily implemented experimentally, and provides access to important experimental noise parameters in quantum computing.

npj Quantum InformationApr 26, 201691 citations