Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Asia-Pacific Software Engineering Conference (APSEC)

An Empirical Study on Self-Admitted Technical Debt in Quantum Software

Yuta Ishimoto, Yuto Nakamura, Ryota Katsube, Naoto Sato, Hideto Ogawa, Masanari Kondo, Yasutaka Kamei, Naoyasu Ubayashi

Published Dec 3, 2024• 6 citations
Publisher

Abstract

Quantum computers, which utilize the principles of quantum mechanics, are expected to be applied to a wide range of fields. With the advancement of quantum computer development, a lot of quantum software, which enables the operation of quantum computers, has been developed. It has a distinct nature (e.g., superposition and entanglement of qubits) compared to traditional software, leading to the unique challenges of its development. While prior studies have clarified and defined some unique challenges of quantum software, many remain unclear due to limited research. In this study, we conducted an empirical study of Self-Admitted Technical Debt (SATD) for quantum software. SATD is a type of technical debt, a problem in the code that the developer is aware of. Hence, we conjecture that analyzing SATDs can reveal the unique challenges developers face when developing quantum software. We manually coded 202 comments from the Python® files of the 61 open-source quantum software on GitHub®. The 202 comments correspond to a 95% confidence level with a 5% confidence interval, as in previous studies. The results showed that 88 comments (45.6% of all SATD comments) were quantum-specific SATDs (QSATDs), which require knowledge of quantum computation to repay. Furthermore, we propose a taxonomy for QSATDs. This taxonomy, which consists of four main categories and eight subcategories, classifies QSATDs in terms of quantum-specific aspects such as circuit implementation, backend, and algorithms. Our empirical results are beneficial for quantum software developers, helping them understand implementation areas that require attention. For researchers, our results promote further research, including the exploration of challenges in QSATD repayment.

DOI
10.1109/apsec65559.2024.00015

Related papers

Understanding Quantum Software Engineering Challenges An Empirical Study on Stack Exchange Forums and GitHub Issues

Mohamed Raed El aoun, Heng Li, Foutse Khomh +1 more

With the advance of quantum computing, quantum software becomes critical for exploring the full potential of quantum computing systems. Recently, quantum software engineering (QSE) becomes an emerging area attracting more and more attention. However, it is not clear what are the challenges and opportunities of quantum computing facing the software engineering community. This work aims to understand the QSE-related challenges perceived by developers. We perform an empirical study on Stack Exchange forums where developers post-QSE-related questions & answers and Github issue reports where developers raise QSE-related issues in practical quantum computing projects. Based on an existing taxonomy of question types on Stack Overflow, we first perform a qualitative analysis of the types of QSE-related questions asked on Stack Exchange forums. We then use automated topic modeling to uncover the topics in QSE-related Stack Exchange posts and GitHub issue reports. Our study highlights some particularly challenging areas of QSE that are different from that of traditional software engineering, such as explaining the theory behind quantum computing code, interpreting quantum program outputs, and bridging the knowledge gap between quantum computing and classical computing, as well as their associated opportunities.

arXiv:2205.03181•IEEE International Conference on Software Maintenance (ICSM)•Sep 1, 2021•47 citations

Code Comments for Quantum Software Development Kits: An Empirical Study on Qiskit

Zenghui Zhou, Yuechen Li, Yi Cai +4 more

Quantum computing is gaining attention from academia and industry. With the quantum Software Development Kits (SDKs), programmers can develop quantum software to explore the power of quantum computing. However, programmers may face challenges in understanding quantum software due to the non-intuitive quantum mechanics. To facilitate software development and maintenance, code comments offered in quantum SDKs serve as a natural language explanation of program functionalities and logical flows. Despite their importance, scarce research systematically reports their value and provides constructive guidelines for programmers. To address this gap, our paper focuses on Qiskit, one of the most popular quantum SDKs, and presents CC4Q, the first dataset of code comments for quantum computing. CC4Q incorporates 12,812 code comment pairs and 28,076 sentence-level code comment units, the latter of which involve heavy human annotation. Regarding the annotation, we validate the applicability of the developer-intent taxonomy used in classical programs, and also propose a new taxonomy considering quantum-specific knowledge. We conduct an empirical study comprehensively interpreting code comments from three perspectives: comment structure and coverage, developers’ intentions, and associated quantum topics. Our findings uncover key differences in code comments between classical and quantum software, and also outline quantum-specific knowledge relevant to quantum software development.

arXiv:2512.00766•ACM Transactions on Software Engineering and Methodology•Sep 15, 2026•1 citation

Understanding Developer Challenges and Underlying Causes in Quantum Computing Toolchains and Algorithms: Mining Stack Overflow Repository

Maryam Tavassoli Sabzevari, Ngo Tu

This repository provides the open dataset accompanying the study on developer challenges in quantum computing, based on an empirical analysis of 1,404 Stack Overflow posts related to quantum computing technologies. The dataset supports the investigation of practitioner-reported challenges, their underlying causes, their variation across development contexts, and their resolution difficulty. The dataset includes coded information extracted from Stack Overflow posts, including challenge categories, underlying cause categories, related quantum tools and platforms, discussed topics, associated quantum algorithms where applicable, and resolution-related metadata such as accepted-answer status and time to accepted answer. The coding was conducted using a taxonomy-guided empirical analysis to support systematic classification and reproducibility. This dataset is intended to support transparency, replication, and further research on quantum software engineering, quantum programming education, toolchain usability, and developer support in quantum computing. It may be reused by researchers, educators, and tool developers interested in understanding the practical difficulties faced by developers when adopting quantum technologies.

•Jun 13, 2026•1 citation

Understanding Developer Challenges and Underlying Causes in Quantum Computing Toolchains and Algorithms: Mining Stack Overflow Repository

Maryam Tavassoli Sabzevari, Ngo Tu, Arif Ali khan

This repository provides the open dataset accompanying the study on developer challenges in quantum computing, based on an empirical analysis of 1,404 Stack Overflow posts related to quantum computing technologies. The dataset supports the investigation of practitioner-reported challenges, their underlying causes, their variation across development contexts, and their resolution difficulty. The dataset includes coded information extracted from Stack Overflow posts, including challenge categories, underlying cause categories, related quantum tools and platforms, discussed topics, associated quantum algorithms where applicable, and resolution-related metadata such as accepted-answer status and time to accepted answer. The coding was conducted using a taxonomy-guided empirical analysis to support systematic classification and reproducibility. This dataset is intended to support transparency, replication, and further research on quantum software engineering, quantum programming education, toolchain usability, and developer support in quantum computing. It may be reused by researchers, educators, and tool developers interested in understanding the practical difficulties faced by developers when adopting quantum technologies.

•Oct 18, 2026•0 citations

Analyzing the Evolution and Maintenance of Quantum Software Repositories

Krishna Upadhyay, Vinaik Chhetri, A. B. Siddique +1 more

Quantum computing is rapidly advancing, but quantum software development faces significant challenges, including a steep learning curve, high hardware error rates, and a lack of mature engineering practices. This study conducts a large-scale mining analysis of over 21,000 GitHub repositories, containing 1.2 million commits from more than 10,000 developers, to examine the evolution and maintenance of quantum software. We analyze repository growth, programming language and framework adoption, and contributor trends, revealing a 200 % increase in repositories and a 150 % rise in contributors since 2017. Additionally, we investigate software development and maintenance practices, showing that perfective commits dominate (51.76 %), while the low occurrence of corrective commits ($\mathbf{1 8. 5 4 \%}$) indicates potential gaps in bug resolution. Furthermore, 34% of reported issues are quantum-specific, highlighting the need for specialized debugging tools beyond conventional software engineering approaches. This study provides empirical insights into the software engineering challenges of quantum computing, offering recommendations to improve development workflows, tooling, and documentation. We are also open-sourcing our dataset to support further analysis by the community and to guide future research and tool development for quantum computing. The dataset is available at: https://github.com/kriss-u/QRepoAnalysis-Paper.

arXiv:2501.06894•IEEE International Conference on Quantum Software (QSW)•Jul 7, 2025•12 citations

An experience-based classification of quantum bugs in quantum software

Nils Quetschlich, Olivia Di Matteo

Abstract As quantum computers continue to improve in quality and scale, there is a growing need for accessible software frameworks for programming them. However, the unique behavior of quantum systems means specialized approaches, beyond traditional software development, are required. This is particularly true for debugging due to quantum bugs, i.e., bugs that occur precisely because an algorithm is a quantum algorithm. Pinpointing a quantum bug’s root cause often requires significant developer time, as there is little established guidance for quantum debugging techniques. Developing such guidance is the main challenge we sought to address. In this work, we describe a set of 14 quantum bugs, sourced primarily from our experience as quantum software developers, and supplemented by analysis of open-source GitHub repositories. We detail their context, symptoms, and the techniques applied to identify and fix them. While classifying these bugs based on existing schemes, we observed that most emerged due to unique interactions between multiple aspects of an algorithm or workflow. In other words, they occurred because more than one thing went wrong, which provided important insight into why quantum debugging is more challenging. Furthermore, based on this clustering, we found that—unexpectedly—there is no clear relationship between debugging strategies and bug classes. Further research is needed to develop effective and systematic quantum debugging strategies.

arXiv:2509.03280•Computing•Sep 8, 2025•4 citations
Quantum computers, which utilize the principles of quantum mechanics, are expected to be applied to a wide range of fields. With the advancement of quantum computer development, a lot of quantum software, which enables the operation of quantum computers, has been developed. It has a distinct nature (e.g., superposition and entanglement of qubits) compared to traditional software, leading to the unique challenges of its development. While prior studies have clarified and defined some unique challenges of quantum software, many remain unclear due to limited research. In this study, we conducted an empirical study of Self-Admitted Technical Debt (SATD) for quantum software. SATD is a type of technical debt, a problem in the code that the developer is aware of. Hence, we conjecture that analyzing SATDs can reveal the unique challenges developers face when developing quantum software. We manually coded 202 comments from the Python® files of the 61 open-source quantum software on GitHub®. The 202 comments correspond to a 95% confidence level with a 5% confidence interval, as in previous studies. The results showed that 88 comments (45.6% of all SATD comments) were quantum-specific SATDs (QSATDs), which require knowledge of quantum computation to repay. Furthermore, we propose a taxonomy for QSATDs. This taxonomy, which consists of four main categories and eight subcategories, classifies QSATDs in terms of quantum-specific aspects such as circuit implementation, backend, and algorithms. Our empirical results are beneficial for quantum software developers, helping them understand implementation areas that require attention. For researchers, our results promote further research, including the exploration of challenges in QSATD repayment.
With the advance of quantum computing, quantum software becomes critical for exploring the full potential of quantum computing systems. Recently, quantum software engineering (QSE) becomes an emerging area attracting more and more attention. However, it is not clear what are the challenges and opportunities of quantum computing facing the software engineering community. This work aims to understand the QSE-related challenges perceived by developers. We perform an empirical study on Stack Exchange forums where developers post-QSE-related questions & answers and Github issue reports where developers raise QSE-related issues in practical quantum computing projects. Based on an existing taxonomy of question types on Stack Overflow, we first perform a qualitative analysis of the types of QSE-related questions asked on Stack Exchange forums. We then use automated topic modeling to uncover the topics in QSE-related Stack Exchange posts and GitHub issue reports. Our study highlights some particularly challenging areas of QSE that are different from that of traditional software engineering, such as explaining the theory behind quantum computing code, interpreting quantum program outputs, and bridging the knowledge gap between quantum computing and classical computing, as well as their associated opportunities.
Quantum computing is gaining attention from academia and industry. With the quantum Software Development Kits (SDKs), programmers can develop quantum software to explore the power of quantum computing. However, programmers may face challenges in understanding quantum software due to the non-intuitive quantum mechanics. To facilitate software development and maintenance, code comments offered in quantum SDKs serve as a natural language explanation of program functionalities and logical flows. Despite their importance, scarce research systematically reports their value and provides constructive guidelines for programmers. To address this gap, our paper focuses on Qiskit, one of the most popular quantum SDKs, and presents CC4Q, the first dataset of code comments for quantum computing. CC4Q incorporates 12,812 code comment pairs and 28,076 sentence-level code comment units, the latter of which involve heavy human annotation. Regarding the annotation, we validate the applicability of the developer-intent taxonomy used in classical programs, and also propose a new taxonomy considering quantum-specific knowledge. We conduct an empirical study comprehensively interpreting code comments from three perspectives: comment structure and coverage, developers’ intentions, and associated quantum topics. Our findings uncover key differences in code comments between classical and quantum software, and also outline quantum-specific knowledge relevant to quantum software development.
This repository provides the open dataset accompanying the study on developer challenges in quantum computing, based on an empirical analysis of 1,404 Stack Overflow posts related to quantum computing technologies. The dataset supports the investigation of practitioner-reported challenges, their underlying causes, their variation across development contexts, and their resolution difficulty. The dataset includes coded information extracted from Stack Overflow posts, including challenge categories, underlying cause categories, related quantum tools and platforms, discussed topics, associated quantum algorithms where applicable, and resolution-related metadata such as accepted-answer status and time to accepted answer. The coding was conducted using a taxonomy-guided empirical analysis to support systematic classification and reproducibility. This dataset is intended to support transparency, replication, and further research on quantum software engineering, quantum programming education, toolchain usability, and developer support in quantum computing. It may be reused by researchers, educators, and tool developers interested in understanding the practical difficulties faced by developers when adopting quantum technologies.
This repository provides the open dataset accompanying the study on developer challenges in quantum computing, based on an empirical analysis of 1,404 Stack Overflow posts related to quantum computing technologies. The dataset supports the investigation of practitioner-reported challenges, their underlying causes, their variation across development contexts, and their resolution difficulty. The dataset includes coded information extracted from Stack Overflow posts, including challenge categories, underlying cause categories, related quantum tools and platforms, discussed topics, associated quantum algorithms where applicable, and resolution-related metadata such as accepted-answer status and time to accepted answer. The coding was conducted using a taxonomy-guided empirical analysis to support systematic classification and reproducibility. This dataset is intended to support transparency, replication, and further research on quantum software engineering, quantum programming education, toolchain usability, and developer support in quantum computing. It may be reused by researchers, educators, and tool developers interested in understanding the practical difficulties faced by developers when adopting quantum technologies.
Quantum computing is rapidly advancing, but quantum software development faces significant challenges, including a steep learning curve, high hardware error rates, and a lack of mature engineering practices. This study conducts a large-scale mining analysis of over 21,000 GitHub repositories, containing 1.2 million commits from more than 10,000 developers, to examine the evolution and maintenance of quantum software. We analyze repository growth, programming language and framework adoption, and contributor trends, revealing a 200 % increase in repositories and a 150 % rise in contributors since 2017. Additionally, we investigate software development and maintenance practices, showing that perfective commits dominate (51.76 %), while the low occurrence of corrective commits (18.54%\mathbf{1 8. 5 4 \%}18.54%) indicates potential gaps in bug resolution. Furthermore, 34% of reported issues are quantum-specific, highlighting the need for specialized debugging tools beyond conventional software engineering approaches. This study provides empirical insights into the software engineering challenges of quantum computing, offering recommendations to improve development workflows, tooling, and documentation. We are also open-sourcing our dataset to support further analysis by the community and to guide future research and tool development for quantum computing. The dataset is available at: https://github.com/kriss-u/QRepoAnalysis-Paper.
Abstract As quantum computers continue to improve in quality and scale, there is a growing need for accessible software frameworks for programming them. However, the unique behavior of quantum systems means specialized approaches, beyond traditional software development, are required. This is particularly true for debugging due to quantum bugs, i.e., bugs that occur precisely because an algorithm is a quantum algorithm. Pinpointing a quantum bug’s root cause often requires significant developer time, as there is little established guidance for quantum debugging techniques. Developing such guidance is the main challenge we sought to address. In this work, we describe a set of 14 quantum bugs, sourced primarily from our experience as quantum software developers, and supplemented by analysis of open-source GitHub repositories. We detail their context, symptoms, and the techniques applied to identify and fix them. While classifying these bugs based on existing schemes, we observed that most emerged due to unique interactions between multiple aspects of an algorithm or workflow. In other words, they occurred because more than one thing went wrong, which provided important insight into why quantum debugging is more challenging. Furthermore, based on this clustering, we found that—unexpectedly—there is no clear relationship between debugging strategies and bug classes. Further research is needed to develop effective and systematic quantum debugging strategies.