Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Quantum certification and benchmarking

Jens Eisert, Dominik Hangleiter, Nathan Walk, Ingo Roth, Damian Markham, Rhea Parekh, Ulysse Chabaud, Elham Kashefi

Published Jan 1, 2020• 258 citations
Publisher

Abstract

With the rapid development of quantum technologies, a pressing need has emerged for a wide array of tools for the certification and characterization of quantum devices. Such tools are critical because the powerful applications of quantum information science will only be realized if stringent levels of precision of components can be reached and their functioning guaranteed. This Technical Review provides a brief overview of the known characterization methods for certification, benchmarking and tomographic reconstruction of quantum states and processes, and outlines their applications in quantum computing, simulation and communication.

DOI
10.17169/refubium-30074

Related papers

Theory of Quantum System Certification

Martin Kliesch, Ingo Roth

The precise control of complex quantum systems promises numerous technological applications including digital quantum computing.The complexity of such devices renders the certification of their correct functioning a challenge.To address this challenge, numerous methods were developed in the last decade.In this tutorial, we explain prominent protocols for certifying the physical layer of quantum devices described by quantum states and processes.Such protocols are particularly important in the development of near-term devices.Specifically, we discuss methods of direct quantum-state certification, direct-fidelity estimation, shadow-fidelity estimation, direct quantum-process certification, randomized benchmarking, and cross-entropy benchmarking.Moreover, we provide an introduction to powerful mathematical methods, which are widely used in quantum-information theory, in order to derive theoretical guarantees for the protocols.

arXiv:2010.05925•PRX Quantum•Jan 29, 2021•139 citations

Theory of Quantum System Certification

Martin Kliesch, Ingo Roth

The precise control of complex quantum systems promises numerous technological applications including digital quantum computing. The complexity of such devices renders the certification of their correct functioning a challenge. To address this challenge, numerous methods were developed in the last decade. In this tutorial, we explain prominent protocols for certifying the physical layer of quantum devices described by quantum states and processes. Such protocols are particularly important in the development of near-term devices. Specifically, we discuss methods of direct quantum-state certification, direct-fidelity estimation, shadow-fidelity estimation, direct quantum-process certification, randomized benchmarking, and cross-entropy benchmarking. Moreover, we provide an introduction to powerful mathematical methods, which are widely used in quantum-information theory, in order to derive theoretical guarantees for the protocols.

•Jan 1, 2021•109 citations

Practical Introduction to Benchmarking and Characterization of Quantum Computers

Akel Hashim, Long B. Nguyen, Noah Goss +16 more

Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV’s core models and concepts—quantum states, measurements, and processes—and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.

arXiv:2408.12064•PRX Quantum•Aug 15, 2025•28 citations

A Survey on Available Tools and Technologies Enabling Quantum Computing

Prateek Singh, R. Dasgupta, Anushka Singh +4 more

In the contemporary era of scientific and technical innovations, we are witnessing remarkable progress in the realm of quantum computing. Today’s phase is referred to as the second quantum revolution, characterized by ongoing research and progress in the hardware, software, and applications of quantum computers. While the theoretical foundations of quantum computing have been in place for decades, the practical tools and technologies that have emerged in recent years have catapulted this field from theory into reality. This paper provides a brief overview of the fundamental principles of quantum computing and explores the various technologies that support them. From quantum programming languages and simulators to quantum hardware platforms and software development kits, these tools have paved the way for groundbreaking research, experimentation, and the exploration of quantum’s boundless potential. Furthermore, it addresses the current developments, existing challenges, ongoing improvements, and future prospects in this dynamic field.

IEEE Access•Jan 1, 2024•49 citations

Adaptive quantum tomography

Evan R. Jeffrey, Joseph B. Altepeter, Nicholas A. Peters +4 more

Quantum states are characterized using quantum tomography, a benchmarking tool used to analyze quantum information systems. We report on advances in tomographic theory and practice which together increase the accuracy and effciency of this analysis.

Conference on Lasers and Electro-Optics•Jan 1, 2004•0 citations

A Review and Collection of Metrics and Benchmarks for Quantum Computers: definitions, methodologies and software

Deep Lall, Abhishek Agarwal, Weixi Zhang +15 more

Quantum computers have the potential to provide an advantage over classical computers in a number of areas. Numerous metrics to benchmark the performance of quantum computers, ranging from their individual hardware components to entire applications, have been proposed over the years. Objective comparisons are further hampered in practice as different variations of the same metric are used, and the data disclosed together with a reported metric value is often not sufficient to reproduce the measurements. In this poster, we present our recent article, where we address these challenges by providing a review of metrics and benchmarks for quantum computers [1], including 1) a comprehensive collection of benchmarks allowing holistic comparisons of quantum computers, 2) a consistent format of the definitions across all metrics including a transparent description of the methodology and of the main assumptions and limitations, and 3) a reproducible approach by linking the metrics to open-source software used to evaluate them . We identify five areas where international standardization working groups could be established, namely: i) the identification and agreement on the categories of metrics that comprehensively benchmark device performance; ii) the identification and agreement on a set of well-established metrics that together comprehensively benchmark performance; iii) the identification of metrics specific to hardware platforms, including non-gate-based quantum computers; iv) inter-laboratory comparison studies to develop best practice guides for measurement methodology; and v) agreement on what data and software should be reported together with a metric value to ensure trust, transparency and reproducibility. We provide potential routes to advancing these areas. We expect that this work will accelerate the progress of quantum computing hardware towards quantum advantage. [1] D. Lall et al., A Review and Collection of Metrics and Benchmarks for Quantum Computers: Definitions, Methodologies and Software, arXiv:2502.06717.

arXiv:2502.06717•Jan 1, 2025•3 citations
With the rapid development of quantum technologies, a pressing need has emerged for a wide array of tools for the certification and characterization of quantum devices. Such tools are critical because the powerful applications of quantum information science will only be realized if stringent levels of precision of components can be reached and their functioning guaranteed. This Technical Review provides a brief overview of the known characterization methods for certification, benchmarking and tomographic reconstruction of quantum states and processes, and outlines their applications in quantum computing, simulation and communication.
The precise control of complex quantum systems promises numerous technological applications including digital quantum computing.The complexity of such devices renders the certification of their correct functioning a challenge.To address this challenge, numerous methods were developed in the last decade.In this tutorial, we explain prominent protocols for certifying the physical layer of quantum devices described by quantum states and processes.Such protocols are particularly important in the development of near-term devices.Specifically, we discuss methods of direct quantum-state certification, direct-fidelity estimation, shadow-fidelity estimation, direct quantum-process certification, randomized benchmarking, and cross-entropy benchmarking.Moreover, we provide an introduction to powerful mathematical methods, which are widely used in quantum-information theory, in order to derive theoretical guarantees for the protocols.
The precise control of complex quantum systems promises numerous technological applications including digital quantum computing. The complexity of such devices renders the certification of their correct functioning a challenge. To address this challenge, numerous methods were developed in the last decade. In this tutorial, we explain prominent protocols for certifying the physical layer of quantum devices described by quantum states and processes. Such protocols are particularly important in the development of near-term devices. Specifically, we discuss methods of direct quantum-state certification, direct-fidelity estimation, shadow-fidelity estimation, direct quantum-process certification, randomized benchmarking, and cross-entropy benchmarking. Moreover, we provide an introduction to powerful mathematical methods, which are widely used in quantum-information theory, in order to derive theoretical guarantees for the protocols.
Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV’s core models and concepts—quantum states, measurements, and processes—and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.
In the contemporary era of scientific and technical innovations, we are witnessing remarkable progress in the realm of quantum computing. Today’s phase is referred to as the second quantum revolution, characterized by ongoing research and progress in the hardware, software, and applications of quantum computers. While the theoretical foundations of quantum computing have been in place for decades, the practical tools and technologies that have emerged in recent years have catapulted this field from theory into reality. This paper provides a brief overview of the fundamental principles of quantum computing and explores the various technologies that support them. From quantum programming languages and simulators to quantum hardware platforms and software development kits, these tools have paved the way for groundbreaking research, experimentation, and the exploration of quantum’s boundless potential. Furthermore, it addresses the current developments, existing challenges, ongoing improvements, and future prospects in this dynamic field.
Quantum computers have the potential to provide an advantage over classical computers in a number of areas. Numerous metrics to benchmark the performance of quantum computers, ranging from their individual hardware components to entire applications, have been proposed over the years. Objective comparisons are further hampered in practice as different variations of the same metric are used, and the data disclosed together with a reported metric value is often not sufficient to reproduce the measurements. In this poster, we present our recent article, where we address these challenges by providing a review of metrics and benchmarks for quantum computers [1], including 1) a comprehensive collection of benchmarks allowing holistic comparisons of quantum computers, 2) a consistent format of the definitions across all metrics including a transparent description of the methodology and of the main assumptions and limitations, and 3) a reproducible approach by linking the metrics to open-source software used to evaluate them . We identify five areas where international standardization working groups could be established, namely: i) the identification and agreement on the categories of metrics that comprehensively benchmark device performance; ii) the identification and agreement on a set of well-established metrics that together comprehensively benchmark performance; iii) the identification of metrics specific to hardware platforms, including non-gate-based quantum computers; iv) inter-laboratory comparison studies to develop best practice guides for measurement methodology; and v) agreement on what data and software should be reported together with a metric value to ensure trust, transparency and reproducibility. We provide potential routes to advancing these areas. We expect that this work will accelerate the progress of quantum computing hardware towards quantum advantage. [1] D. Lall et al., A Review and Collection of Metrics and Benchmarks for Quantum Computers: Definitions, Methodologies and Software, arXiv:2502.06717.