Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2307.06833 · ACM Transactions on Quantum Computing

Impact of Unreliable Devices on Stability of Quantum Computations

Samudra Dasgupta, Travis S. Humble

Published Jul 29, 2024• 7 citations
arXivHTMLPDF

Abstract

Noisy intermediate-scale quantum (NISQ) devices are valuable platforms for testing the tenets of quantum computing, but these devices are susceptible to errors arising from de-coherence, leakage, cross-talk, and other sources of noise. This raises concerns regarding the stability of results when using NISQ devices since strategies for mitigating errors generally require well-characterized and stationary error models. Here, we quantify the reliability of NISQ devices by assessing the necessary conditions for generating stable results within a given tolerance. We use similarity metrics derived from device characterization data to derive and validate bounds on the stability of a 5-qubit implementation of the Bernstein-Vazirani algorithm. Simulation experiments conducted with noise data from IBM washington, spanning January 2022 to April 2023, revealed that the reliability metric fluctuated between 41% and 92%. This variation significantly surpasses the maximum allowable threshold of 2.2% needed for stable outcomes. Consequently, the device proved unreliable for consistently reproducing the statistical mean in the context of the Bernstein-Vazirani circuit.

DOI
10.1145/3682071

Related papers

Stability of noisy quantum computing devices

Samudra Dasgupta, Travis S. Humble

Noisy, intermediate-scale quantum (NISQ) computing devices offer opportunities to test the principles of quantum computing but are prone to errors arising from various sources of noise. Fluctuations in the noise itself lead to unstable devices that undermine the reproducibility of NISQ results. Here we characterize the reliability of NISQ devices by quantifying the stability of essential performance metrics. Using the Hellinger distance, we quantify the similarity between experimental characterizations of several NISQ devices by comparing gate fidelities, duty cycles, and register addressability across temporal and spatial scales. Our observations collected over 22 months reveal large fluctuations in each metric that underscore the limited scales on which current NISQ devices may be considered reliable.

arXiv:2105.09472•May 20, 2021•17 citations

Reliable Devices Yield Stable Quantum Computations

Samudra Dasgupta, Travis S. Humble

Stable quantum computation requires noisy results to remain bounded even in the presence of noise fluctuations. Yet non-stationary noise processes lead to drift in the varying characteristics of a quantum device that can greatly influence the circuit outcomes. Here we address how temporal and spatial variations in noise relate device reliability to quantum computing stability. First, our approach quantifies the differences in statistical distributions of characterization metrics collected at different times and locations using Hellinger distance. We then validate an analytical bound that relates this distance directly to the stability of a computed expectation value. Our demonstration uses numerical simulations with models informed by the washington superconducting transmon device. We find that the stability metric is consistently bounded from above by the corresponding Hellinger distance, which can be cast as a specified tolerance level. These results underscore the significance of reliable quantum computing devices and the impact for stable quantum computation.

arXiv:2307.05381•IEEE International Conference on Quantum Computing and Engineering (QCE)•Sep 17, 2023•3 citations

Reproducibility in Quantum Computing

Samudra Dasgupta, Travis S. Humble

Reproducibility is important for validating the performance of applications in quantum computing as a measure of consistency in computation. Current noisy, intermediate-scale devices quantum (NISQ) devices are strongly affected by intrinsic noise that leads to a variety of computational error mechanisms. Here we assess reproducibility of NISQ computing by focusing on a specific simple error mechanism that arises during noisy readout. Using an asymmetric channel for binary readout, we develop an analytic bound on the Hellinger distance between computational outputs for different readout parameters. We validate this model using characterization and testing of the IBM toronto device, which displays a range of readout parameters. We find that to ensure reproducibility, one must avoid using register elements characterized by fidelity asymmetry exceeding a threshold.

IEEE Computer Society Annual Symposium on VLSI•Jul 1, 2021•6 citations

Characterizing the Stability of NISQ Devices

Samudra Dasgupta, Travis S. Humble

In this study, we focus on the question of stability of NISQ devices. The parameters that define the device stability profile are motivated by the work of DiVincenzo where the requirements for physical implementation of quantum computing are discussed. We develop the metrics and theoretical framework to quantify the DiVincenzo requirements and study the stability of those key metrics. The basis of our assessment is histogram similarity (in time and space). For identical experiments, devices which produce reproducible histograms in time, and similar histograms in space, are considered more reliable. To investigate such reliability concerns robustly, we propose a moment-based distance (MBD) metric. We illustrate our methodology using data collected from IBM's Yorktown device. Two types of assessments are discussed: spatial stability and temporal stability.

arXiv:2008.09612•IEEE International Conference on Quantum Computing and Engineering (QCE)•Oct 1, 2020•20 citations

Characterizing the Reproducibility of Noisy Quantum Circuits

Samudra Dasgupta, Travis S. Humble

The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.

arXiv:2204.01529•Entropy•Feb 5, 2022•31 citations

TQEA: Temporal Quantum Error Analysis

Betis Baheri, Daniel Chen, Bo Fang +6 more

The growth of need of quantum computers in many domains such as machine learning, numerical scientific simulation and finance has urged the quantum computers to produce more stable and less error-prone results. However, to mitigate the impact of the noise inside each quantum device remains a present challenge. In this paper, we investigate the temporal behavior of noisy intermediate-scale quantum (NISQ) computer errors based on calibration data and the characteristics of individual devices. In particular, we collect calibration data of IBM-Q machines over 90 days and compare the quantum error robustness across processor types, quantum topology and quantum volumes. We analyze the aging effect by comparing the quantum error data from four IBM quantum computers during 2019-2021 showing that only one computer experienced significant error growth overtime. In this study, we simply analyze the collected data and run temporal test analysis to observe the behaviour of IBM-Q computers.

IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S)•Jun 1, 2021•8 citations
Noisy intermediate-scale quantum (NISQ) devices are valuable platforms for testing the tenets of quantum computing, but these devices are susceptible to errors arising from de-coherence, leakage, cross-talk, and other sources of noise. This raises concerns regarding the stability of results when using NISQ devices since strategies for mitigating errors generally require well-characterized and stationary error models. Here, we quantify the reliability of NISQ devices by assessing the necessary conditions for generating stable results within a given tolerance. We use similarity metrics derived from device characterization data to derive and validate bounds on the stability of a 5-qubit implementation of the Bernstein-Vazirani algorithm. Simulation experiments conducted with noise data from IBM washington, spanning January 2022 to April 2023, revealed that the reliability metric fluctuated between 41% and 92%. This variation significantly surpasses the maximum allowable threshold of 2.2% needed for stable outcomes. Consequently, the device proved unreliable for consistently reproducing the statistical mean in the context of the Bernstein-Vazirani circuit.
Noisy, intermediate-scale quantum (NISQ) computing devices offer opportunities to test the principles of quantum computing but are prone to errors arising from various sources of noise. Fluctuations in the noise itself lead to unstable devices that undermine the reproducibility of NISQ results. Here we characterize the reliability of NISQ devices by quantifying the stability of essential performance metrics. Using the Hellinger distance, we quantify the similarity between experimental characterizations of several NISQ devices by comparing gate fidelities, duty cycles, and register addressability across temporal and spatial scales. Our observations collected over 22 months reveal large fluctuations in each metric that underscore the limited scales on which current NISQ devices may be considered reliable.
Stable quantum computation requires noisy results to remain bounded even in the presence of noise fluctuations. Yet non-stationary noise processes lead to drift in the varying characteristics of a quantum device that can greatly influence the circuit outcomes. Here we address how temporal and spatial variations in noise relate device reliability to quantum computing stability. First, our approach quantifies the differences in statistical distributions of characterization metrics collected at different times and locations using Hellinger distance. We then validate an analytical bound that relates this distance directly to the stability of a computed expectation value. Our demonstration uses numerical simulations with models informed by the washington superconducting transmon device. We find that the stability metric is consistently bounded from above by the corresponding Hellinger distance, which can be cast as a specified tolerance level. These results underscore the significance of reliable quantum computing devices and the impact for stable quantum computation.
Reproducibility is important for validating the performance of applications in quantum computing as a measure of consistency in computation. Current noisy, intermediate-scale devices quantum (NISQ) devices are strongly affected by intrinsic noise that leads to a variety of computational error mechanisms. Here we assess reproducibility of NISQ computing by focusing on a specific simple error mechanism that arises during noisy readout. Using an asymmetric channel for binary readout, we develop an analytic bound on the Hellinger distance between computational outputs for different readout parameters. We validate this model using characterization and testing of the IBM toronto device, which displays a range of readout parameters. We find that to ensure reproducibility, one must avoid using register elements characterized by fidelity asymmetry exceeding a threshold.
In this study, we focus on the question of stability of NISQ devices. The parameters that define the device stability profile are motivated by the work of DiVincenzo where the requirements for physical implementation of quantum computing are discussed. We develop the metrics and theoretical framework to quantify the DiVincenzo requirements and study the stability of those key metrics. The basis of our assessment is histogram similarity (in time and space). For identical experiments, devices which produce reproducible histograms in time, and similar histograms in space, are considered more reliable. To investigate such reliability concerns robustly, we propose a moment-based distance (MBD) metric. We illustrate our methodology using data collected from IBM's Yorktown device. Two types of assessments are discussed: spatial stability and temporal stability.
The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.
The growth of need of quantum computers in many domains such as machine learning, numerical scientific simulation and finance has urged the quantum computers to produce more stable and less error-prone results. However, to mitigate the impact of the noise inside each quantum device remains a present challenge. In this paper, we investigate the temporal behavior of noisy intermediate-scale quantum (NISQ) computer errors based on calibration data and the characteristics of individual devices. In particular, we collect calibration data of IBM-Q machines over 90 days and compare the quantum error robustness across processor types, quantum topology and quantum volumes. We analyze the aging effect by comparing the quantum error data from four IBM quantum computers during 2019-2021 showing that only one computer experienced significant error growth overtime. In this study, we simply analyze the collected data and run temporal test analysis to observe the behaviour of IBM-Q computers.