Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2406.06836 · International Conference on Innovative and Intelligent Information Technologies (IC3IT)

Comparative Study of Quantum Transpilers: Evaluating the Performance of Qiskit-Braket-Provider, qBraid-SDK, and Pytket Extensions

Mohamed Messaoud Louamri, Nacer Eddine Belaloui, Abdellah Tounsi, Mohamed Taha Rouabah

Published Dec 3, 2024• 2 citations
arXivHTMLPDF

Abstract

In this study, we present a comprehensive evaluation of popular SDK-to-SDK quantum transpilers (that is transpilers that takes a quantum circuit from an initial SDK and output a quantum circuit in another SDK), focusing on critical metrics such as correctness, failure rate, and transpilation time. To ensure unbiased evaluation and accommodate diverse quantum computing scenarios, we developed two dedicated tools: RandomQC, for generating random quantum circuits across various types (pure random, VQE-like, and SDK-specific circuits), and Benchmarq, to streamline the benchmarking process. Using these tools, we benchmarked prominent quantum transpilers as of February 2024. Our results highlight the superior performance of the qiskit-braket-provider, a specialized transpiler from Qiskit to Braket, achieving a remarkably low failure rate of 0. 2 %. The qBraid-SDK, offering generalized transpilation across multiple SDKs, demonstrated robust but slower performance. The pytket extensions, while fast, faced limitations with complex circuits due to their one-to-one transpilation approach. In particular, the exceptional performance of the qiskit-bracket-provider stems not only from its specialization but also from its architecture, which combines one-to-one transpilation with gate decomposition for unsupported gates, enhancing both speed and capability. This study aims to provide practical guidelines to users of SDK-to-SDK quantum transpilers and guidance to developers for improving the design and development of future tools.

DOI
10.1109/ic3it63743.2024.10869429

Related papers

Quantum Circuit Compiler for a Shuttling-Based Trapped-Ion Quantum Computer

Fabian Kreppel, Christian Melzer, Diego Olvera Millán +5 more

The increasing capabilities of quantum computing hardware and the challenge of realizing deep quantum circuits require fully automated and efficient tools for compiling quantum circuits. To express arbitrary circuits in a sequence of native gates specific to the quantum computer architecture, it is necessary to make algorithms portable across the landscape of quantum hardware providers. In this work, we present a compiler capable of transforming and optimizing a quantum circuit targeting a shuttling-based trapped-ion quantum processor. It consists of custom algorithms set on top of the quantum circuit framework Pytket. The performance was evaluated for a wide range of quantum circuits and the results show that the gate counts can be reduced by factors up to 5.1 compared to standard Pytket and up to 2.2 compared to standard Qiskit compilation.

arXiv:2207.01964•Quantum•Nov 8, 2023•27 citations

Development of a vendor independent quantum computing transpiler

Wangler, Thomas

In 2019 a quantum computer took 200 seconds for a task for which a state-of-the-art classical supercomputer would need roughly 10,000 years. Quantum supremacy was shown and the development of quantum technology proceeds quickly. However, several aspects limit the implementation and execution of quantum circuits. The vendors of quantum computers provide their own proprietary software development kit (SDK) to execute quantum circuits on their quantum processing units (QPUs). Furthermore, the computers differ regarding various properties like the native gate set and the qubit connectivity. Therefore, quantum circuits cannot be executed on arbitrary QPUs, but there exists a tight coupling between a QPU and a quantum algorithm implementation. To decouple the development of a circuit from the QPU, this thesis proposes a quantum circuit analysis and transpilation framework that integrates quantum SDKs and enables the comparison and analysis of quantum circuits, as well as the export of executable circuits in the respective assembly language of QPUs from different vendors. Currently existing QPUs, also called Noisy Intermediate-Scale Quantum (NISQ) machines, have a very limited number of qubits and are prone to failure. Thus, the integration of different QPUs enhances the possibilities of quantum circuit developers and avoids the SDK lock-in. Additionally, a graphical user interface is developed to support the user in the whole process of importing, visualizing, editing, and simulating a quantum circuit, as well as, choosing a suitable QPU to execute the circuit.

•Jan 1, 2020•0 citations

A 200-Line Python Micro-Benchmark Suite for NISQ Circuit Compilers

Juhani Merilehto

We present microbench.py, a compact (approx. 200 lines) Python script that automates the collection of key compiler metrics, i.e., gate depth, two-qubit-gate count, wall-clock compilation time, and memory footprint, across multiple open-source quantum circuit transpilers. The suite ships with six didactic circuits (3 to 8 qubits) implementing fundamental quantum algorithms and supports Qiskit, tket, Cirq, and the Qiskit-Braket provider; in this paper we showcase results for Qiskit 0.46 and Braket 1.16. The entire run completes in under three minutes on a laptop, emits a single CSV plus publisheable plot, and reproduces the figure here with one command. We release the code under the MIT licence to serve as a quick-start regression harness for NISQ compiler research.

arXiv:2509.16205•Jul 4, 2025•0 citations

A Teleportation Protocol Variant for Single-QPU Benchmarking

Carmen Márquez, Daniel Sierra-Sosa, Kelly Garcés

With the advent of more quantum computing applications, it is imperative to provide developers with a set of metrics to determine how much trust they can place in the execution of their programs. In this study, we propose a novel protocol based on quantum teleportation to systematically evaluate the performance of quantum circuits and quantify their execution reliability. Our protocol consists of three parts: the payload, composed of entangled qubits with random gates applied to each wire; the bridge, which corresponds to the teleportation-inspired protocol; and an inverse payload operation, designed to return the circuit to its initial state. We validated the algorithm by elaborating its mathematical framework, followed by a comparative analysis with simulation results using Qiskit AerSimulator and ultimately through an execution on the IBM quantum and Rigetti services. A key aspect of our methodology was to set the circuit transpilation to its lowest optimization level (level 0). We recognize that even without aggressive optimization, randomly generated gates can form self-canceling sequences. As a result, our analysis correlates the pre-runtime metrics of the final, minimally-transpiled circuit (such as its actual depth and gate count) with post-runtime results (such as success rate). This approach reveals significant correlations and offers developers quantitative metrics to assess both the reliability of quantum circuit execution and scalability limitations in their applications.

IEEE Access•Jan 1, 2025•0 citations

QASMTrans: A QASM based Quantum Transpiler Framework for NISQ Devices

Hua, Fei, Meng Wang, Gushu Li +8 more

The success of a quantum algorithm hinges on the ability to orchestrate a successful application induction. Detrimental overheads in mapping general quantum circuits to physically implementable routines can be the deciding factor between a successful and erroneous circuit induction. In QASMTrans, we focus on the problem of rapid circuit transpilation. Transpilation plays a crucial role in converting high-level, machine-agnostic circuits into machine-specific circuits constrained by physical topology and supported gate sets. The efficiency of transpilation continues to be a substantial bottleneck, especially when dealing with larger circuits requiring high degrees of inter-qubit interaction. QASMTrans is a high-performance C++ quantum transpiler framework that demonstrates up to 369X speedups compared to the commonly used Qiskit transpiler. We observe speedups on large dense circuits such as uccsd_n24 and qft_n320 which require O(10^6) gates. QASMTrans successfully transpiles the aforementioned circuits in 69s and 31s, whilst Qiskit exceeded an hour of transpilation time. With QASMTrans providing transpiled circuits in a fraction of the time of prior transpilers, potential design space exploration, and heuristic-based transpiler design becomes substantially more tractable. QASMTrans is released at http://github.com/pnnl/qasmtrans.

arXiv:2308.07581•Aug 15, 2023•0 citations

QASMTrans: A QASM Quantum Transpiler Framework for NISQ Devices

Fei Hua, Meng Wang, Gushu Li +8 more

The success of a quantum algorithm hinges on the ability to orchestrate a successful application induction. Detrimental overheads in mapping general quantum circuits to physically implementable routines can be the deciding factor between a successful and erroneous circuit induction. In QASMTrans, we focus on the problem of rapid circuit transpilation. Transpilation plays a crucial role in converting high-level, machine-agnostic circuits into machine-specific circuits constrained by physical topology and supported gate sets. The efficiency of transpilation continues to be a substantial bottleneck, especially when dealing with larger circuits requiring high degrees of inter-qubit interaction. QASMTrans is a high-performance C++ quantum transpiler framework that demonstrates 3-1111 × speedups compared to the commonly used Qiskit transpiler. We observe speedups on large dense circuits such as ‘uccsd_n24’ which require gates. QASMTrans successfully transpiles the aforementioned circuits in 7.9s, whilst Qiskit needs 502 seconds with optimization 1 and exceeds an hour of transpilation time with optimization 3. With QASMTrans providing transpiled circuits in a fraction of the time of prior transpilers, potential design space exploration, and heuristic-based transpiler design becomes substantially more tractable. QASMTrans is released at http://github.com/pnnl/qasmtrans.

International Conference for High Performance Computing, Networking, Storage and Analysis (SC)•Nov 10, 2023•15 citations
In this study, we present a comprehensive evaluation of popular SDK-to-SDK quantum transpilers (that is transpilers that takes a quantum circuit from an initial SDK and output a quantum circuit in another SDK), focusing on critical metrics such as correctness, failure rate, and transpilation time. To ensure unbiased evaluation and accommodate diverse quantum computing scenarios, we developed two dedicated tools: RandomQC, for generating random quantum circuits across various types (pure random, VQE-like, and SDK-specific circuits), and Benchmarq, to streamline the benchmarking process. Using these tools, we benchmarked prominent quantum transpilers as of February 2024. Our results highlight the superior performance of the qiskit-braket-provider, a specialized transpiler from Qiskit to Braket, achieving a remarkably low failure rate of 0. 2 %. The qBraid-SDK, offering generalized transpilation across multiple SDKs, demonstrated robust but slower performance. The pytket extensions, while fast, faced limitations with complex circuits due to their one-to-one transpilation approach. In particular, the exceptional performance of the qiskit-bracket-provider stems not only from its specialization but also from its architecture, which combines one-to-one transpilation with gate decomposition for unsupported gates, enhancing both speed and capability. This study aims to provide practical guidelines to users of SDK-to-SDK quantum transpilers and guidance to developers for improving the design and development of future tools.
The increasing capabilities of quantum computing hardware and the challenge of realizing deep quantum circuits require fully automated and efficient tools for compiling quantum circuits. To express arbitrary circuits in a sequence of native gates specific to the quantum computer architecture, it is necessary to make algorithms portable across the landscape of quantum hardware providers. In this work, we present a compiler capable of transforming and optimizing a quantum circuit targeting a shuttling-based trapped-ion quantum processor. It consists of custom algorithms set on top of the quantum circuit framework Pytket. The performance was evaluated for a wide range of quantum circuits and the results show that the gate counts can be reduced by factors up to 5.1 compared to standard Pytket and up to 2.2 compared to standard Qiskit compilation.
In 2019 a quantum computer took 200 seconds for a task for which a state-of-the-art classical supercomputer would need roughly 10,000 years. Quantum supremacy was shown and the development of quantum technology proceeds quickly. However, several aspects limit the implementation and execution of quantum circuits. The vendors of quantum computers provide their own proprietary software development kit (SDK) to execute quantum circuits on their quantum processing units (QPUs). Furthermore, the computers differ regarding various properties like the native gate set and the qubit connectivity. Therefore, quantum circuits cannot be executed on arbitrary QPUs, but there exists a tight coupling between a QPU and a quantum algorithm implementation. To decouple the development of a circuit from the QPU, this thesis proposes a quantum circuit analysis and transpilation framework that integrates quantum SDKs and enables the comparison and analysis of quantum circuits, as well as the export of executable circuits in the respective assembly language of QPUs from different vendors. Currently existing QPUs, also called Noisy Intermediate-Scale Quantum (NISQ) machines, have a very limited number of qubits and are prone to failure. Thus, the integration of different QPUs enhances the possibilities of quantum circuit developers and avoids the SDK lock-in. Additionally, a graphical user interface is developed to support the user in the whole process of importing, visualizing, editing, and simulating a quantum circuit, as well as, choosing a suitable QPU to execute the circuit.
We present microbench.py, a compact (approx. 200 lines) Python script that automates the collection of key compiler metrics, i.e., gate depth, two-qubit-gate count, wall-clock compilation time, and memory footprint, across multiple open-source quantum circuit transpilers. The suite ships with six didactic circuits (3 to 8 qubits) implementing fundamental quantum algorithms and supports Qiskit, tket, Cirq, and the Qiskit-Braket provider; in this paper we showcase results for Qiskit 0.46 and Braket 1.16. The entire run completes in under three minutes on a laptop, emits a single CSV plus publisheable plot, and reproduces the figure here with one command. We release the code under the MIT licence to serve as a quick-start regression harness for NISQ compiler research.
With the advent of more quantum computing applications, it is imperative to provide developers with a set of metrics to determine how much trust they can place in the execution of their programs. In this study, we propose a novel protocol based on quantum teleportation to systematically evaluate the performance of quantum circuits and quantify their execution reliability. Our protocol consists of three parts: the payload, composed of entangled qubits with random gates applied to each wire; the bridge, which corresponds to the teleportation-inspired protocol; and an inverse payload operation, designed to return the circuit to its initial state. We validated the algorithm by elaborating its mathematical framework, followed by a comparative analysis with simulation results using Qiskit AerSimulator and ultimately through an execution on the IBM quantum and Rigetti services. A key aspect of our methodology was to set the circuit transpilation to its lowest optimization level (level 0). We recognize that even without aggressive optimization, randomly generated gates can form self-canceling sequences. As a result, our analysis correlates the pre-runtime metrics of the final, minimally-transpiled circuit (such as its actual depth and gate count) with post-runtime results (such as success rate). This approach reveals significant correlations and offers developers quantitative metrics to assess both the reliability of quantum circuit execution and scalability limitations in their applications.
The success of a quantum algorithm hinges on the ability to orchestrate a successful application induction. Detrimental overheads in mapping general quantum circuits to physically implementable routines can be the deciding factor between a successful and erroneous circuit induction. In QASMTrans, we focus on the problem of rapid circuit transpilation. Transpilation plays a crucial role in converting high-level, machine-agnostic circuits into machine-specific circuits constrained by physical topology and supported gate sets. The efficiency of transpilation continues to be a substantial bottleneck, especially when dealing with larger circuits requiring high degrees of inter-qubit interaction. QASMTrans is a high-performance C++ quantum transpiler framework that demonstrates up to 369X speedups compared to the commonly used Qiskit transpiler. We observe speedups on large dense circuits such as uccsd_n24 and qft_n320 which require O(10^6) gates. QASMTrans successfully transpiles the aforementioned circuits in 69s and 31s, whilst Qiskit exceeded an hour of transpilation time. With QASMTrans providing transpiled circuits in a fraction of the time of prior transpilers, potential design space exploration, and heuristic-based transpiler design becomes substantially more tractable. QASMTrans is released at http://github.com/pnnl/qasmtrans.
The success of a quantum algorithm hinges on the ability to orchestrate a successful application induction. Detrimental overheads in mapping general quantum circuits to physically implementable routines can be the deciding factor between a successful and erroneous circuit induction. In QASMTrans, we focus on the problem of rapid circuit transpilation. Transpilation plays a crucial role in converting high-level, machine-agnostic circuits into machine-specific circuits constrained by physical topology and supported gate sets. The efficiency of transpilation continues to be a substantial bottleneck, especially when dealing with larger circuits requiring high degrees of inter-qubit interaction. QASMTrans is a high-performance C++ quantum transpiler framework that demonstrates 3-1111 × speedups compared to the commonly used Qiskit transpiler. We observe speedups on large dense circuits such as ‘uccsd_n24’ which require gates. QASMTrans successfully transpiles the aforementioned circuits in 7.9s, whilst Qiskit needs 502 seconds with optimization 1 and exceeds an hour of transpilation time with optimization 3. With QASMTrans providing transpiled circuits in a fraction of the time of prior transpilers, potential design space exploration, and heuristic-based transpiler design becomes substantially more tractable. QASMTrans is released at http://github.com/pnnl/qasmtrans.