Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Framework for Hybrid Software Evaluation (Classical - Quantum)

Ana Díaz Muñoz

Published Jan 1, 2025• 0 citations
OpenAlex

Abstract

This doctoral dissertation, presented in the form of a compendium of publications, focuses on the design, implementation, and validation of an innovative model for evaluating analyz- ability—understood as a key subcharacteristic of maintainability—in the context of quantum software and, more broadly, hybrid software systems (those integrating classical and quantum components). In a landscape where quantum computing is rapidly advancing and beginning to consolidate in industrial applications, a pressing need arises to adapt and extend traditional software quality models, such as those established in the ISO/IEC 25000 family, to address the specific characteristics of quantum code. The lack of dedicated metrics hinders the rigorous evaluation of critical attributes like analyzability, negatively affecting hybrid systems’ maintainability, evolvability, and reliability in highly complex technical environments. The main objective of this dissertation is the design, implementation, and validation of an evaluation model focused on analyzability, which combines adapted classical metrics with newly defined indicators tailored explicitly for the quantum component. While the model targets hybrid systems, the validation has been exclusively focused on the quantum component, which constitutes the core contribution of this research. The classical part relies on well-established metrics validated and certified by bodies such as ILAC and ENAC and has therefore not been experimentally evaluated in this work. Additionally, an automated technological environment has been developed as a key element of the compendium, facilitating the practical application of the model in real-world projects. This environment enables integrated and real-time measurement of both classical and quantum metrics. However, like the model, its validation has been limited to the novel quantum indicators defined in this thesis. This approach strengthens the proposed methodology and lays the groundwork for future validation of the fully integrated hybrid model. The adopted methodology is grounded in an exhaustive review of the state of the art, the formal and informal definition of metrics, the development of the automated environment, and empirical validation through a family of experiments. The compendium of publications includes, among others, the following articles: Towards a set of metrics for hybrid (quan- tum/classical) systems maintainability, Implementing an environment for hybrid software evaluation, and Environment for the Evaluation of Hybrid (Classical-Quantum) Systems Analyzability. As part of the validation process, a preliminary study has been accepted at the international conference IQSOFT 2025, and an extended version has been submitted to the journal Empirical Software Engineering (EmSE), and is currently under review. The results demonstrate that the proposed model enables precise quantification of quantum software analyzability and that its application in hybrid systems is feasible conceptually and technically. The developed technological environment supports reproducible and systematic evaluation, laying a foundation for future applications in hybrid software engineering. The em- pirical validation conducted thus far has been deliberately limited to the quantum component, given that classical metrics are already widely established and certified. In conclusion, this dissertation represents a significant advance in the evaluation of hybrid software quality. It proposes a validated model that contributes to strengthening maintain- ability and supporting the evolution of complex systems in an ever-changing technological landscape.

Related papers

Validation of an Analysability Model in Hybrid Quantum Software

Ana Díaz Muñoz, José A. Cruz-Lemus, Rodríguez Moisés +2 more

In the context of quantum-classical hybrid computing, evaluating analysability, which is the ease of understanding and modifying software, presents significant challenges due to the complexity and novelty of quantum algorithms. Although advances have been made in quantum software development, standard software quality evaluation methods do not fully address the specifics of quantum components, resulting in a gap in the ability to ensure and maintain the quality of hybrid software products. In this registered report proposal, we intend to validate a quality model focused on the analysability of hybrid software through an international collab orative approach involving academic institutions from Italy and Spain through a controlled experiment. This approach allows for a more detailed analysis and validation methodology and establishes a framework for future research and developments in software quality assessment in quantum computing.

arXiv:2408.01105•Aug 2, 2024•0 citations

Towards a hybrid classical–quantum software architecture derived from literature harmonization

Carlos Eduardo Orozco Garcés, César Pardo, Ricardo Pérez del Castillo +1 more

Introduction: This article is the result of doctoral research conducted in 2025 on quantum software architecture, addressing the transformative potential of quantum computing and the challenges associated with integrating quantum capabilities into software systems. Problem: The lack of standardized architectural models for hybrid classical–quantum systems limits interoperability, reuse, and systematic software design. Objective: This study proposes a reference architecture to support the design and evolution of hybrid classical–quantum software systems. Methodology: The architecture was derived through a harmonization process. Results: The proposed framework defines ten architectural elements organized across three dimensions: Conceptual, Organizational, and Quality. Conclusion: The architecture provides a structured foundation for designing hybrid classical–quantum solutions. Originality: The work consolidates dispersed knowledge into a unified framework for hybrid classical–quantum systems. Limitations: The model is based on the currently limited body of literature and industrial experience, requiring future validation.

Ingenieria Solidaria•Sep 1, 2026•0 citations

Towards a set of metrics for hybrid (quantum/classical) systems maintainability

Ana Díaz Muñoz, Moisés Rodríguez, Mario G. Piattini

Given the rapid evolution that has taken place in recent years in the software industry, and along with it the emergence of quantum software, there is a need to design an environment for measuring quality metrics for hybrid, classic-quantum software. In order to measure and evaluate the quality of classic software, there are models and standards, among which ISO/IEC 25000 stands out, which proposes a set of quality characteristics such as maintainability. However, there is currently no consensus for the measurement and evaluation of quantum software quality. In this paper we propose a series of adaptations to “classic” metrics, as well as a set of new measurements for hybrid maintainability. Finally, a first prototype of a measurement tool developed as a SonarQube plugin, capable of measuring these metrics in quantum developments, is also presented.

JUCS - Journal of Universal Computer Science•Jan 22, 2024•14 citations

Quantum-ready software engineering: principles, frameworks, and hybrid development pipelines

Hasanain Hazim Azeez

Quantum computing is quickly becoming a potentially disruptive technology that can tackle the problems inaccessible to classical computers, but the use of quantum computing in real software systems has yet to be fully explored. Present day quantum studies are largely focused on the development of algorithms and hardware, whereas engineering workflows to be used to enable smooth hybrid quantum-classical operations attract limited attention. The paper suggests a concept of quantum-ready software engineering- a systematic approach to applying established principles of software engineering to hybrid systems. In order to meet maintainability, scalability, and reliability objectives in hybrid applications, propose the adoption of a multilayered design, such as abstraction, integration, orchestration, and verification. An example concrete programming template, written in Python in Qiskit, demonstrates how quantum functions being used as modular services can be simulated with classical software. Evaluation measures (maintainability index, latency, and modularity) demonstrate the feasibility of the framework. Results indicate that the hybrid pipelines can be designed in a systematic way using quantum-classical-adapted design patterns. The study introduces a repeatable methodology, program templates, and design pattern engineering principles, which open the door to additional development of quantum DevOps and design pattern formalization. This project, by bridging the gap between classical software engineering and quantum integration, gives a platform upon which to build extraordinarily reliable, scalable systems in the Noisy Intermediate-Scale Quantum and beyond.

International Journal of Information technology and Computer Engineering•Sep 13, 2025•1 citation

Design of classical-quantum systems with UML

Ricardo Pérez‐Castillo, Mario G. Piattini

Abstract Developers of the many promising quantum computing applications that currently exist are urging companies in many different sectors seriously consider integrating this new technology into their business. For these applications to function, not only are quantum computers required, but quantum software also. Accordingly, quantum software engineering has become an important research field, in that it attempts to apply or adapt existing methods and techniques (or propose new ones) for the analysis, design, coding, and testing of quantum software, as well as playing a key role in ensuring quality in large-scale productions. The design of quantum software nevertheless poses two main challenges: the modelling of software quantum elements must be done in high-level modelling languages; and the need to further develop so-called “hybrid information systems”, which combine quantum and classical software. To address these challenges, we first propose a quantum UML profile for analysing and designing hybrid information systems; we then demonstrate its applicability through various structural and behavioural diagrams such as use case, class, sequence, activity, and deployment. In comparison to certain other quantum domain-specific languages, this UML profile ensures compliance with a well-known international standard that is supported by many tools and is followed by an extensive community.

Computing•May 31, 2022•40 citations

Quantum Software Size: What Do We Measure, How and Why? A Systematic Literature Review

Tuna Hacaloğlu, Hassan Soubra, Pierre Bourque +1 more

Rapid growth in quantum computing has created an urgent need to adapt traditional software engineering methodologies. Among these methodological challenges, software size measurement plays a central role in project estimation, quality assurance, and software engineering management. However, there is no consolidated understanding of how it should be applied to quantum software systems. This paper presents the first systematic literature review on quantum software size measurement, synthesizing existing approaches, and identifying key research gaps. An analysis of 16 studies shows that size measures span multiple abstraction levels, with most research focusing on adapting classical metrics, such as Lines of Code (LOC) and functional size, to quantum software systems. LOC continues to be used for sizing quantum code, while COSMIC Function Points (ISO 19761) have been extended to capture data movements in quantum components, enabling their application at the requirement, code, and circuit levels. At the specification and architectural design levels, the proposed measures include counts of quantum classes and methods as well as lines of architectural specifications. At the circuit level, quantum-specific constructs, such as qubits, gates, and measurements, are also incorporated. Additionally, software structure metrics, including cyclomatic complexity and Halstead metrics, are used to measure quantum software at both the code and design levels. Research output has grown since 2024, and is driven by academic groups, with minimal industrial participation. However, most metrics remain conceptual, lack empirical validation, and are not integrated into development life cycles, highlighting the immaturity and fragmentation of current proposals and the need for standardized frameworks.

IEEE Access•Jan 1, 2026•1 citation
This doctoral dissertation, presented in the form of a compendium of publications, focuses on the design, implementation, and validation of an innovative model for evaluating analyz- ability—understood as a key subcharacteristic of maintainability—in the context of quantum software and, more broadly, hybrid software systems (those integrating classical and quantum components). In a landscape where quantum computing is rapidly advancing and beginning to consolidate in industrial applications, a pressing need arises to adapt and extend traditional software quality models, such as those established in the ISO/IEC 25000 family, to address the specific characteristics of quantum code. The lack of dedicated metrics hinders the rigorous evaluation of critical attributes like analyzability, negatively affecting hybrid systems’ maintainability, evolvability, and reliability in highly complex technical environments. The main objective of this dissertation is the design, implementation, and validation of an evaluation model focused on analyzability, which combines adapted classical metrics with newly defined indicators tailored explicitly for the quantum component. While the model targets hybrid systems, the validation has been exclusively focused on the quantum component, which constitutes the core contribution of this research. The classical part relies on well-established metrics validated and certified by bodies such as ILAC and ENAC and has therefore not been experimentally evaluated in this work. Additionally, an automated technological environment has been developed as a key element of the compendium, facilitating the practical application of the model in real-world projects. This environment enables integrated and real-time measurement of both classical and quantum metrics. However, like the model, its validation has been limited to the novel quantum indicators defined in this thesis. This approach strengthens the proposed methodology and lays the groundwork for future validation of the fully integrated hybrid model. The adopted methodology is grounded in an exhaustive review of the state of the art, the formal and informal definition of metrics, the development of the automated environment, and empirical validation through a family of experiments. The compendium of publications includes, among others, the following articles: Towards a set of metrics for hybrid (quan- tum/classical) systems maintainability, Implementing an environment for hybrid software evaluation, and Environment for the Evaluation of Hybrid (Classical-Quantum) Systems Analyzability. As part of the validation process, a preliminary study has been accepted at the international conference IQSOFT 2025, and an extended version has been submitted to the journal Empirical Software Engineering (EmSE), and is currently under review. The results demonstrate that the proposed model enables precise quantification of quantum software analyzability and that its application in hybrid systems is feasible conceptually and technically. The developed technological environment supports reproducible and systematic evaluation, laying a foundation for future applications in hybrid software engineering. The em- pirical validation conducted thus far has been deliberately limited to the quantum component, given that classical metrics are already widely established and certified. In conclusion, this dissertation represents a significant advance in the evaluation of hybrid software quality. It proposes a validated model that contributes to strengthening maintain- ability and supporting the evolution of complex systems in an ever-changing technological landscape.
In the context of quantum-classical hybrid computing, evaluating analysability, which is the ease of understanding and modifying software, presents significant challenges due to the complexity and novelty of quantum algorithms. Although advances have been made in quantum software development, standard software quality evaluation methods do not fully address the specifics of quantum components, resulting in a gap in the ability to ensure and maintain the quality of hybrid software products. In this registered report proposal, we intend to validate a quality model focused on the analysability of hybrid software through an international collab orative approach involving academic institutions from Italy and Spain through a controlled experiment. This approach allows for a more detailed analysis and validation methodology and establishes a framework for future research and developments in software quality assessment in quantum computing.
Introduction: This article is the result of doctoral research conducted in 2025 on quantum software architecture, addressing the transformative potential of quantum computing and the challenges associated with integrating quantum capabilities into software systems. Problem: The lack of standardized architectural models for hybrid classical–quantum systems limits interoperability, reuse, and systematic software design. Objective: This study proposes a reference architecture to support the design and evolution of hybrid classical–quantum software systems. Methodology: The architecture was derived through a harmonization process. Results: The proposed framework defines ten architectural elements organized across three dimensions: Conceptual, Organizational, and Quality. Conclusion: The architecture provides a structured foundation for designing hybrid classical–quantum solutions. Originality: The work consolidates dispersed knowledge into a unified framework for hybrid classical–quantum systems. Limitations: The model is based on the currently limited body of literature and industrial experience, requiring future validation.
Given the rapid evolution that has taken place in recent years in the software industry, and along with it the emergence of quantum software, there is a need to design an environment for measuring quality metrics for hybrid, classic-quantum software. In order to measure and evaluate the quality of classic software, there are models and standards, among which ISO/IEC 25000 stands out, which proposes a set of quality characteristics such as maintainability. However, there is currently no consensus for the measurement and evaluation of quantum software quality. In this paper we propose a series of adaptations to “classic” metrics, as well as a set of new measurements for hybrid maintainability. Finally, a first prototype of a measurement tool developed as a SonarQube plugin, capable of measuring these metrics in quantum developments, is also presented.
Quantum computing is quickly becoming a potentially disruptive technology that can tackle the problems inaccessible to classical computers, but the use of quantum computing in real software systems has yet to be fully explored. Present day quantum studies are largely focused on the development of algorithms and hardware, whereas engineering workflows to be used to enable smooth hybrid quantum-classical operations attract limited attention. The paper suggests a concept of quantum-ready software engineering- a systematic approach to applying established principles of software engineering to hybrid systems. In order to meet maintainability, scalability, and reliability objectives in hybrid applications, propose the adoption of a multilayered design, such as abstraction, integration, orchestration, and verification. An example concrete programming template, written in Python in Qiskit, demonstrates how quantum functions being used as modular services can be simulated with classical software. Evaluation measures (maintainability index, latency, and modularity) demonstrate the feasibility of the framework. Results indicate that the hybrid pipelines can be designed in a systematic way using quantum-classical-adapted design patterns. The study introduces a repeatable methodology, program templates, and design pattern engineering principles, which open the door to additional development of quantum DevOps and design pattern formalization. This project, by bridging the gap between classical software engineering and quantum integration, gives a platform upon which to build extraordinarily reliable, scalable systems in the Noisy Intermediate-Scale Quantum and beyond.
Abstract Developers of the many promising quantum computing applications that currently exist are urging companies in many different sectors seriously consider integrating this new technology into their business. For these applications to function, not only are quantum computers required, but quantum software also. Accordingly, quantum software engineering has become an important research field, in that it attempts to apply or adapt existing methods and techniques (or propose new ones) for the analysis, design, coding, and testing of quantum software, as well as playing a key role in ensuring quality in large-scale productions. The design of quantum software nevertheless poses two main challenges: the modelling of software quantum elements must be done in high-level modelling languages; and the need to further develop so-called “hybrid information systems”, which combine quantum and classical software. To address these challenges, we first propose a quantum UML profile for analysing and designing hybrid information systems; we then demonstrate its applicability through various structural and behavioural diagrams such as use case, class, sequence, activity, and deployment. In comparison to certain other quantum domain-specific languages, this UML profile ensures compliance with a well-known international standard that is supported by many tools and is followed by an extensive community.
Rapid growth in quantum computing has created an urgent need to adapt traditional software engineering methodologies. Among these methodological challenges, software size measurement plays a central role in project estimation, quality assurance, and software engineering management. However, there is no consolidated understanding of how it should be applied to quantum software systems. This paper presents the first systematic literature review on quantum software size measurement, synthesizing existing approaches, and identifying key research gaps. An analysis of 16 studies shows that size measures span multiple abstraction levels, with most research focusing on adapting classical metrics, such as Lines of Code (LOC) and functional size, to quantum software systems. LOC continues to be used for sizing quantum code, while COSMIC Function Points (ISO 19761) have been extended to capture data movements in quantum components, enabling their application at the requirement, code, and circuit levels. At the specification and architectural design levels, the proposed measures include counts of quantum classes and methods as well as lines of architectural specifications. At the circuit level, quantum-specific constructs, such as qubits, gates, and measurements, are also incorporated. Additionally, software structure metrics, including cyclomatic complexity and Halstead metrics, are used to measure quantum software at both the code and design levels. Research output has grown since 2024, and is driven by academic groups, with minimal industrial participation. However, most metrics remain conceptual, lack empirical validation, and are not integrated into development life cycles, highlighting the immaturity and fragmentation of current proposals and the need for standardized frameworks.