This paper presents preliminary findings from a multivocal literature review investigating how quantum software testing is characterized across academic and practitioner-oriented sources. Our study integrated peer-reviewed studies with gray literature, including blogs, tutorials, forums, technical reports, documentation pages, and company webpages. Our results indicate a rapidly evolving but fragmented ecosystem involving classical adapted testing approaches, quantum-specific techniques, statistical validation methods, simulators, debugging environments, and verification frameworks. The reviewed material also revealed recurring challenges related to scalability limitations, hardware noise, probabilistic execution, limited observability, and immature tooling ecosystems. These findings provide an initial characterization of how research and practice currently discuss quantum software testing challenges, techniques, and tooling.
This paper presents preliminary findings from a multivocal literature review investigating how quantum software testing is characterized across academic and practitioner-oriented sources. Our study integrated peer-reviewed studies with gray literature, including blogs, tutorials, forums, technical reports, documentation pages, and company webpages. Our results indicate a rapidly evolving but fragmented ecosystem involving classical adapted testing approaches, quantum-specific techniques, statistical validation methods, simulators, debugging environments, and verification frameworks. The reviewed material also revealed recurring challenges related to scalability limitations, hardware noise, probabilistic execution, limited observability, and immature tooling ecosystems. These findings provide an initial characterization of how research and practice currently discuss quantum software testing challenges, techniques, and tooling.
In quantum software engineering (QSE), quantum software testing (QST) has attracted increasing attention as quantum software systems grow in scale and complexity. Since QST evaluates quantum programs through execution under designed test inputs, empirical studies are widely used to assess the effectiveness of testing approaches. However, the design and reporting of empirical studies in QST remain highly diverse, and a shared methodological understanding has yet to emerge, making it difficult to interpret results and compare findings across studies. This paper presents a methodological analysis of empirical studies in QST through a systematic examination of 59 primary studies identified from a literature pool of size 384. We organize our analysis around ten research questions that cover key methodological dimensions of QST empirical studies, including objects under test, baseline comparison, testing setup, experimental configuration, and tool and artifact support. Through cross-study analysis along these dimensions, we characterize current empirical practices in QST, identify recurring limitations and inconsistencies, and highlight open methodological challenges. Based on our findings, we derive insights and recommendations to inform the design, execution, and reporting of future empirical studies in QST.
Quantum software testing introduces new challenges that differ fundamentally from those in classical software engineering. Aims: This study investigates how the quantum software industry defines testing roles and what skills are expected from professionals in these positions. Method: We analyzed 110 job postings from organizations involved in quantum software and hardware development, identifying activities, competencies, and skill requirements related to testing. Results: The findings show that testing in quantum contexts combines traditional software quality assurance with experimental validation, emphasizing calibration, control, and hybrid quantum-classical verification. Employers seek professionals who integrate programming and automation expertise with quantum-specific technical knowledge and interdisciplinary collaboration skills. Conclusions: Quantum software testing remains at an early but rapidly evolving stage that bridges software engineering and experimental physics, highlighting the need for educational and research efforts that align testing practices with industrial realities.
Quantum computing has existed in the theoretical realm for several decades. Recently, quantum computing has re-emerged as a promising technology to solve problems that a classical computer could take hundreds of years to solve. However, there are challenges and opportunities for academics and practitioners regarding software engineering practices for testing and debugging quantum programs. This article presents a roadmap for addressing these challenges, pointing out the existing gaps in the literature and suggesting research directions. We discuss the limitations caused by noise, the no-cloning theorem, the lack of a standard architecture for quantum computers, among others. Regarding testing, we highlight gaps and opportunities related to transpilation, mutation analysis, input states with hybrid interfaces, program analysis, and coverage. For debugging, we present the current strategies, including classical techniques applied to quantum programs, quantum-specific assertions, and quantum-related bug patterns. We introduce a conceptual model to illustrate concepts regarding the testing and debugging of quantum programs and the relationship between them. Those concepts are used to identify and discuss research challenges to cope with quantum programs through 2030, focusing on the interfaces between classical and quantum computing and on creating testing and debugging techniques that take advantage of the unique quantum computing characteristics.
Abstract Quantum computing (QC) hinged upon the bedrock principles of quantum theory and holds promise for reforming a large number of industries. The researcher in this area aims to deliver a comprehensive understanding of the current state of the art and future trajectories of QC. The authors have discovered that most academic studies have concentrated upon dissecting specific aspects of QC. This discernment underscores the exigency of identifying challenges that might impede the seamless integration of QC within the software industry. Moreover, it becomes crucial to ascertain the panoply of solutions/practices required to overcome these barriers. A comprehensive multi‐vocal literature review was performed and culled a total of 49 academic papers for data extraction. A total of 13 challenges encountered by organisations were identified during the adoption of QC. Subsequently, these challenges were examined deeply and determined that five of them are the most critical, these are ‘Lack of quantum specific algorithms, dev and testing methodologies’, ‘Difficult compilation and debugging’, ‘Lack of development tools and technology’, ‘Lack of development guidelines & Quality Assurance Standards’ and ‘Lack of professional expert’, together founding over 30% of occurrences. These challenges from various perspectives were evaluated, including time frame, methodology, geographical region and publication platform. To address these barriers and implement the QC in software industry effectively, a total of 53 practices/solutions. This research aims to share valuable knowledge to simplify and amplify quantum application development.
As quantum computing transitions from a theoretical domain to a practical technology, many aspects of established practice in software engineering are being faced with new challenges. Quantum Software Engineering has been developed to address the peculiar needs that arise with quantum systems’ dependable, scalable, and fault-tolerant software development. The present paper critically reviews how traditional software engineering methodologies can be reshaped to fit into the quantum field. This also entails providing some critical contributions: frameworks to integrate classical and quantum systems, new error mitigation techniques, and the development of quantum-specific testing and debugging tools. In this respect, best practices have been recommended to ensure that future quantum software can harness the evolving capabilities of quantum hardware with continued performance, reliability, and scalability. The work is supposed to act as a foundational guide for the researcher and developer as quantum computing approaches widespread scientific and industrial adoption.
Quantum computing represents one of the most transformative technological shifts in computational science since the advent of classical computing architectures. This systematic literature review (SLR) synthesizes 212 peer-reviewed studies published between 2015 and 2024 to map the current landscape of quantum computing research as it intersects with software development practices, tools, frameworks, and methodologies. Following the PRISMA 2020 guidelines, we searched six major academic databases and identified relevant literature through a rigorous multi-stage screening process. Our analysis reveals five dominant research themes: quantum algorithm development and software frameworks, quantum machine learning integration, quantum cryptography and security applications, quantum software testing and verification, and hybrid quantum-classical software architectures. We further document major challenges including hardware decoherence, limited qubit availability, the absence of mature quantum DevOps pipelines, and a critical shortage of quantum-competent software engineers. The review concludes with a structured research agenda identifying six high-priority gaps where future scholarly work is most urgently needed. This paper provides a foundational reference for software engineers, researchers, and technology strategists seeking to understand and navigate the rapidly evolving quantum software ecosystem.