Benchmarking quantum computers often deals with the parameters of single qubits or gates and sometimes deals with algorithms run on an entire chip or a noisy simulator of a chip. Here we propose the idea of using protocols to benchmark quantum computers. The advantage of using protocols, especially the seven suggested here, over other benchmarking methods is that there is a clear cutoff (i.e., a threshold) distinguishing quantumness from classicality for each of our protocols. The protocols we suggest enable a comparison among various circuit-based quantum computers, and also between real chips and their noisy simulators. This latter method may then be used to better understand the various types of noise of the real chips. We use some of these protocols to answer an important question: ``How many effective qubits are there in this N-qubit quantum computer/simulator?'', and we then conclude which effective sub-chips can be named ``truly-quantum''.
Benchmarking quantum computers often deals with the parameters of single qubits or gates and sometimes deals with algorithms run on an entire chip or a noisy simulator of a chip. Here we propose the idea of using protocols to benchmark quantum computers. The advantage of using protocols, especially the seven suggested here, over other benchmarking methods is that there is a clear cutoff (i.e., a threshold) distinguishing quantumness from classicality for each of our protocols. The protocols we suggest enable a comparison among various circuit-based quantum computers, and also between real chips and their noisy simulators. This latter method may then be used to better understand the various types of noise of the real chips. We use some of these protocols to answer an important question: How many effective qubits are there in this N-qubit quantum computer/simulator?'', and we then conclude which effective sub-chips can be named truly-quantum''.
Context: The main obstacle of quantum computing on its way to scalability is the noisy nature of current hardware. Various types of errors lead to incorrect computational results,and measures such as quantum error mitigation are needed to counteract these errors. Many error mitigation techniques require a thorough understanding of the noise and its impact on computations. Therefore, accurate noise models are indispensable to facilitate meaningful quantum computing in the near future. They also enable realistic simulations of quantum devices. Since these devices are currently limited and quantum computing is expensive, researchers typically rely on simulations for testing their algorithms.Objective: In this thesis, we aim to construct a realistic noise model for quantum computing and optimise its model parameters. The model construction should build on the underlying physical processes, and the number of parameters should scale well with the system size. We also address the evaluation and comparison of different noise models by benchmarks using quantum circuits specific to real-world applications. Finally, we aim to develop useful graphical representations of noise models based on the existing quantum circuit model.Method: We present a benchmarking framework for quantum computing noise models and evaluate it based on benchmarking quality attributes from the literature. Moreover, we construct a quantum computing noise model and develop a training procedure for its parameters. We analyse the parameters of the trained noise model and the impact ofdifferent types of errors on computations. We benchmark the noise model with the above approach and compare it to a noise model provided by IBM’s software development kit Qiskit. Finally, we develop an extension of the quantum circuit model to represent noise channels.Result: The benchmarks performed in this thesis show that our noise model predicts noisy hardware behaviour of IBM’s ibmq_manila quantum device equally well as the Qiskit model, if not better, based on quantum circuits commonly used for variational quantum algorithms. Within the trained noise model, readout error has the most detrimental impact on computations. Our benchmarking approach satisfies relevant quality criteria by choosing suitable quantum circuits and objective functions to compare model predictionsto hardware data. Moreover, the quantum circuit model can be extended meaningfully by noise channels.Conclusion: Our benchmarking approach is suitable for evaluating and comparing quantum computing noise models. In future work, volumetric benchmarks should be performed for various noise models and application contexts. The parameter optimisation based on learning with training circuits yields accurate noise models and shows the importance of mitigating measurement error. Different optimisation algorithms and quantum circuits should be explored, and more types of noise should be incorporated into the noise model.
As quantum computing hardware rapidly advances, objectively evaluating the capabilities and error rates of new processors remains a critical challenge for the field. A clear and realistic understanding of current quantum performance is essential for guiding research priorities and driving meaningful progress. In this work, we apply and extend a protocol-based benchmarking methodology (Meirom, Mor, Weinstein Arxiv 2505.12441) that utilizes well-defined \underline{quantumness} thresholds. By evaluating performance at protocol level rather than the gate level, this approach provides a transparent and intuitive assessment of whether specific quantum processors, or isolated sub-chips within them, can demonstrate a practical quantum advantage. To illustrate the utility of this method, we compare two generations of IBM quantum computers: the older Eagle architecture and the newer Heron architecture. Our findings reveal the genuine operational strengths and limitations of these devices, demonstrating substantial performance improvements in the newer Heron generation. This work was made possible by IBM Quantum policies that enable independent and objective assessment of its quantum computers and sub-chips. We strongly encourage other companies to emulate the independent qubit availability and the fair pricing that allow researchers to perform such assessments.
Both Superconducting and Ion-Trap are leading quantum architectures common in the current landscape of the quantum computing field, each with distinct characteristics and operational constraints. Understanding and measuring the underlying \underline{quantumness} of these devices is essential for assessing their readiness for practical applications and guiding future progress and research. Building on earlier work (Meirom, Mor and Weinstein Arxiv 2505.12441), we utilize a benchmarking strategy applicable for comparing these two architectures by measuring "quantumness" directly on optimal sub-chips. Distinct from existing metrics, our approach employs rigorous binary fidelity thresholds derived from the classical limits of state transfer. This enables us to definitively establish quantum advantage of a designated sub-region. Here we apply this quality assurance methodology to platforms from both technologies. This comparison provides a protocol-based evaluation of quantumness advantage, revealing not only the strengths and weaknesses of each tested chip and its sub-chips but also offering a common language for their assessment. By abstracting away technical differences in the final result, we demonstrate a benchmarking strategy that bridges the gap between disparate quantum-circuit technologies, enabling fair performance comparisons and establishing a critical foundation for evaluating future claims of quantum advantage. This work was made possible by policies of two companies who enable independent and objective assessment on their quantum computers and sub-chips. In the name of science, we encourage other companies to emulate the independent qubit availability and the fair pricing which allow researchers to preform such assessments.
In this research notebook on quantum computation and quantum communication protocol for quantum engineers, researchers, and scientists, we will discuss and summarize the practical challenges of implementing quantum computing algorithms and quantum communication protocols in today's real-world hardware systems. We will begin the discussion about the noise and its effect on quantum coherence and the mathematical models to represent the impact of noise on the physical systems. Furthermore, we will discuss the basic concepts of noise that practically limit quantum computation and quantum communication. We will discuss several mathematical methods to characterize, model, and represent the practical impact of noise. Next, we will discuss how photon loss impacts quantum communication protocols. We will summarize the current physical limitations and challenges facing quantum computation and quantum communication over optical fiber. We will also discuss technology options that can mitigate or eliminate the physical limitations for realizing quantum computation and quantum communication protocol. Later we will consider the methods being developed to mitigate such losses in larger-scale communication systems. We will investigate the current limitations of quantum computing algorithms and the need to develop near-term practical applications that can be successfully performed on noisy qubits. We will also review the challenges associated with implementing algorithms on the relatively noisy, intermediate-scale qubits used in today's technology domain. Finally, we will investigate how to benchmark qubits and quantum gates in the presence of noise. We will discuss several methods to benchmark quantum states and quantum gates and finally implement benchmarking of qubits in a real physical quantum computer on the IBM Q Experience.
The characterization of noisy quantum circuits is an important step in the development of large-scale quantum computers. As experimental quantum architectures approach the threshold for fault-tolerant quantum computing, obtaining a benchmark of process fidelities is needed to verify the integrity of the system and ensure functionality. Additionally, the ability to successfully implement a quantum code of choice may depend on the type of noise that is present in the system. It is therefore necessary to characterize not only the fidelity of the process, but also the structure of the noise. \n \nRandomized benchmarking is a characterization protocol which extracts partial information from a noisy quantum process. This thesis gives a detailed review of the randomized benchmarking protocol, and presents the results of three collaborative projects which use techniques similar to randomized benchmarking to obtain previously hidden information. The first protocol is designed to obtain a benchmark on loss errors. This protocol also provides information on the detector efficiency and an additional constraint on estimated parameters from randomized benchmarking. The second protocol is an extension of the first, under the special case of coherent leakage errors, for which we obtain an estimate of the leakage rate. The third protocol provides a method of testing for spatial correlations in noisy processes. This test may be used to determine the correlation structure of errors, and the error correcting codes needed for successful experiments in a particular architecture. All protocols presented in this thesis are scalable, platform-independent and insensitive to state preparation and measurement errors. We also provide results of numerical tests of these protocols for simulated noise, which show their accuracy and robustness.
Benchmarking is how the performance of a computing system is determined. Surprisingly, even for classical computers this is not a straightforward process. One must choose the appropriate benchmark and metrics to extract meaningful results. Different benchmarks test the system in different ways, and each individual metric may or may not be of interest. Choosing the appropriate approach is tricky. The situation is even more open ended for quantum computers, where there is a wider range of hardware, fewer established guidelines, and additional complicating factors. Notably, quantum noise significantly impacts performance and is difficult to model accurately. Here, we discuss benchmarking of quantum computers from a computer architecture perspective and provide numerical simulations highlighting challenges that suggest caution.