Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2611.16902

Non-Functional Requirements to Hyperparameter Translation for Quantum Software via LLMs

Joseph G. Bronyah, Nasir U. Eisty

Published Nov 12, 2026• 0 citations
arXivHTMLPDF

Abstract

Quantum software engineering (QSE) lacks validated approaches for translating natural-language non-functional requirements (NFRs) into execution parameters such as shots and transpiler optimization levels. Existing methods emphasize semantic similarity rather than execution outcomes. We evaluate seven large language models (LLMs) against a deterministic heuristic baseline using 540 synthetic and 18 real-world user stories. We assess semantic accuracy and execution outcomes, including time, cost, top-state probability, and two-qubit gate exposure, through Qiskit/Aer simulations. All LLMs significantly outperformed the heuristic in semantic accuracy, achieving 55.6 to 83.3 percent on real-world stories compared to 16.7 percent for the heuristic. However, no LLM demonstrated statistically significant superiority over others on the real-world dataset. Speed- and cost-oriented configurations reduced execution time and cost, but fidelity improvements were not supported. Some failures resulted from provider safety refusals rather than translation errors. Our findings demonstrate the potential of LLMs as middleware for NFR-to-configuration translation in QSE, while emphasizing execution-based validation, human oversight, and careful interpretation of model differences.

DOI
10.48550/arxiv.2611.16902

Related papers

Large Language Models for Quantum Code Translation: An Exploratory Study

Xiyuan Li, Yuechen Li, Jianjun Zhao

Quantum software development is challenged by quantum-mechanical semantics and fragmented software development kits (SDKs), which complicate cross-SDK code translation and execution. In this paper, we propose an LLM-based approach for translating executable programs between high-level quantum SDKs. We develop a quantum-aware translation workflow whose prompt design and validation reflect quantum semantics and accommodate the version evolution of quantum ecosystems. We conduct a preliminary evaluation of 4 LLM configurations on 43 tasks, translating Qiskit programs to PennyLane and Q#. LLMs achieve a zero-shot Pass@1 of up to 72.33%, while one-shot prompting further improves the translation effectiveness. These results suggest potential for quantum code translation by LLMs.

cs.SECross-listedarXiv:2610.34841•Oct 27, 2026•0 citations

QPipe: LLM-Based Agentic Quantum Application Generation for Test Optimization

Ming Tao, Yuechen Li, Tao Yue +2 more

Quantum computing is increasingly explored for software engineering (SE) optimization, but translating natural-language (NL) task-level requirements into executable quantum applications still demands substantial quantum and programming expertise. We present QPipe, a large language model (LLM)-based multi-agent architecture that autonomously turns NL requirements into traceable quantum-application workflows through specialized agents for requirement parsing, formulation, code generation, review, execution, and verification. We evaluate QPipe on 20 NL requirements, each associated with a real-world benchmark and a test-optimization problem. QPipe successfully completes the key stages of quantum-application generation across requirements, achieving average rates of 100% for code compilation and 96.7% for application execution and final-result combination, with average generation costs of 260.1 seconds and 1.89M tokens per requirement. Among the generated quantum applications that execute successfully, the returned solutions outperform the offline genetic algorithm baseline in most cases. Ablation results further show that QPipe's advantage depends on retaining code-generation skills, task knowledge, review feedback, and multi-agent decomposition. These results indicate that agentic coordination can support generation of executable quantum applications for tackling test optimization problems from real-world benchmarks.

cs.SECross-listedarXiv:2607.00939•Jul 2, 2026•3 citations

Are Large Language Models Ready for Quantum Software Engineering? A Multivocal Literature Review

Antonio Della Porta, Stefano Lambiase, Andrea De Lucia +1 more

Abstract Quantum computing is steadily transitioning from theoretical exploration to experimental deployment, bringing with it distinct engineering challenges. This shift has led to the emergence of Quantum Software Engineering (QSE), a research area that adapts and extends software engineering principles to the quantum domain. In parallel, Large Language Models (LLMs) have become widely adopted in classical software development workflows. Although their potential to assist QSE tasks is increasingly discussed, existing evidence remains fragmented across research venues and practitioner sources. This study presents a Multivocal Literature Review that systematically synthesizes peer-reviewed and grey literature to characterize how LLMs are used in QSE and assess their reported limitations. We identified and analyzed 24 primary sources, mapped their contributions onto the quantum software development lifecycle, examined the distribution of adopted LLM families, and synthesized recurring limitations. The results show that LLM adoption in QSE is predominantly code-centric, with most studies focusing on program synthesis, repair, and refactoring, while lifecycle phases such as requirements engineering, architectural reasoning, and comprehensive validation receive limited attention. Reported challenges include semantic inaccuracies, execution failures on real quantum backends, sensitivity to prompt formulation, and limited domain coverage. Moreover, the empirical landscape is largely shaped by proprietary models, raising concerns regarding reproducibility and longitudinal comparability. Overall, current evidence suggests that LLMs function primarily as assistive tools for bounded tasks rather than as robust, lifecycle-spanning engineering agents in quantum software development.

•Jun 24, 2026•1 citation

A Protocol-Guided LLM Agent for Quantum Program Synthesis and Execution

Ming-Kang Ho, Tai-Yue Li

This study evaluates a protocol-guided large language model (LLM) agent workflow for quantum program synthesis and execution. A versioned YAML protocol specifies interface and quantum-semantic requirements while leaving circuit design to the model. The workflow combines Qiskit circuit generation, evaluator-guided repair, and quantum processing unit (QPU) deployment. A matched ablation evaluates four LLM endpoints using the variational quantum eigensolver (VQE) for H$_2$, the quantum approximate optimization algorithm (QAOA) for MaxCut, and Fashion-MNIST quantum-kernel classification. Across 240 trials, protocol guidance increased evaluator completion from 80.0\% to 99.2\%, reduced mean repairs from 2.56 to 0.75, and reduced mean agent time from 55.70 to 30.58~s. Provider-reported token use decreased for three of four endpoints. Completed VQE trials meeting chemical accuracy increased from 16/40 to 29/40, while valid QAOA approximation ratios remained comparable. Semantic review identified rank-one fidelity kernels, reinforcing the distinction between evaluator completion and semantic validity. A 210-run IBM QPU study evaluated the combined generation-and-selection pipelines and confirmed deployment feasibility. The results support protocol guidance as a software-reliability layer that must be complemented by quantum-semantic validation.

quant-pharXiv:2609.20258•Jul 29, 2026•1 citation

QuanBench: Benchmarking Quantum Code Generation with Large Language Models

Xiaoyu Guo, Minggu Wang, Jianjun Zhao

Large language models (LLMs) have demonstrated good performance in general code generation; however, their capabilities in quantum code generation remain insufficiently studied. This paper presents QuanBench, a benchmark for evaluating LLMs on quantum code generation. QuanBench includes 44 programming tasks that cover quantum algorithms, state preparation, gate decomposition, and quantum machine learning. Each task has an executable canonical solution and is evaluated by functional correctness (Pass@K) and quantum semantic equivalence (Process Fidelity). We evaluate several recent LLMs, including general-purpose and code-specialized models. The results show that current LLMs have limited capability in generating the correct quantum code, with overall accuracy below 40% and frequent semantic errors. We also analyze common failure cases, such as outdated API usage, circuit construction errors, and incorrect algorithm logic. QuanBench provides a basis for future work on improving quantum code generation with LLMs.

arXiv:2510.16779•IEEE/ACM International Conference on Automated Software Engineering (ASE)•Nov 16, 2025•26 citations

Trustworthy Natural Language Interfaces for Quantum Optimization: A Secure and Resilient Translation Framework

Kensay Sato, Mehtaab Singh, Rishabh Dhadda +4 more

As quantum computing emerges as a powerful tool for solving combinatorial optimization problems, the absence of intuitive programming interfaces remains a major barrier to practical adoption. This work presents a secure and resilient natural language interface that translates high-level optimization prompts into QUBO (Quadratic Unconstrained Binary Optimization) formulations suitable for quantum solvers such as D-Wave. The translation pipeline leverages large language models (LLMs) and incorporates multiple verification layers, including schema validation, constraint compliance checks, and reverse translation for semantic fidelity auditing. Fidelity is quantified using cosine similarity between sentence embeddings of the original and reconstructed problem descriptions, enabling intent alignment analysis. We evaluate the system across 100 optimization instances spanning five canonical problem types: Knapsack, Traveling Salesman Problem, Graph Coloring, Seating Assignment, and Team Assignment. Results show that GPT-4 significantly outperforms GPT-3.5 in complex cases such as TSP, achieving up to$90\%$success rates where earlier models fail entirely. Latency measurements confirm interactive performance, with most translations completing in under 6 seconds. These results demonstrate the feasibility of trustworthy natural language interfaces for quantum optimization and provide a framework for verifiable, interpretable, and efficient translation from user intent to quantum-executable code.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Aug 30, 2025•0 citations
Quantum software engineering (QSE) lacks validated approaches for translating natural-language non-functional requirements (NFRs) into execution parameters such as shots and transpiler optimization levels. Existing methods emphasize semantic similarity rather than execution outcomes. We evaluate seven large language models (LLMs) against a deterministic heuristic baseline using 540 synthetic and 18 real-world user stories. We assess semantic accuracy and execution outcomes, including time, cost, top-state probability, and two-qubit gate exposure, through Qiskit/Aer simulations. All LLMs significantly outperformed the heuristic in semantic accuracy, achieving 55.6 to 83.3 percent on real-world stories compared to 16.7 percent for the heuristic. However, no LLM demonstrated statistically significant superiority over others on the real-world dataset. Speed- and cost-oriented configurations reduced execution time and cost, but fidelity improvements were not supported. Some failures resulted from provider safety refusals rather than translation errors. Our findings demonstrate the potential of LLMs as middleware for NFR-to-configuration translation in QSE, while emphasizing execution-based validation, human oversight, and careful interpretation of model differences.
Quantum software development is challenged by quantum-mechanical semantics and fragmented software development kits (SDKs), which complicate cross-SDK code translation and execution. In this paper, we propose an LLM-based approach for translating executable programs between high-level quantum SDKs. We develop a quantum-aware translation workflow whose prompt design and validation reflect quantum semantics and accommodate the version evolution of quantum ecosystems. We conduct a preliminary evaluation of 4 LLM configurations on 43 tasks, translating Qiskit programs to PennyLane and Q#. LLMs achieve a zero-shot Pass@1 of up to 72.33%, while one-shot prompting further improves the translation effectiveness. These results suggest potential for quantum code translation by LLMs.
Quantum computing is increasingly explored for software engineering (SE) optimization, but translating natural-language (NL) task-level requirements into executable quantum applications still demands substantial quantum and programming expertise. We present QPipe, a large language model (LLM)-based multi-agent architecture that autonomously turns NL requirements into traceable quantum-application workflows through specialized agents for requirement parsing, formulation, code generation, review, execution, and verification. We evaluate QPipe on 20 NL requirements, each associated with a real-world benchmark and a test-optimization problem. QPipe successfully completes the key stages of quantum-application generation across requirements, achieving average rates of 100% for code compilation and 96.7% for application execution and final-result combination, with average generation costs of 260.1 seconds and 1.89M tokens per requirement. Among the generated quantum applications that execute successfully, the returned solutions outperform the offline genetic algorithm baseline in most cases. Ablation results further show that QPipe's advantage depends on retaining code-generation skills, task knowledge, review feedback, and multi-agent decomposition. These results indicate that agentic coordination can support generation of executable quantum applications for tackling test optimization problems from real-world benchmarks.
Abstract Quantum computing is steadily transitioning from theoretical exploration to experimental deployment, bringing with it distinct engineering challenges. This shift has led to the emergence of Quantum Software Engineering (QSE), a research area that adapts and extends software engineering principles to the quantum domain. In parallel, Large Language Models (LLMs) have become widely adopted in classical software development workflows. Although their potential to assist QSE tasks is increasingly discussed, existing evidence remains fragmented across research venues and practitioner sources. This study presents a Multivocal Literature Review that systematically synthesizes peer-reviewed and grey literature to characterize how LLMs are used in QSE and assess their reported limitations. We identified and analyzed 24 primary sources, mapped their contributions onto the quantum software development lifecycle, examined the distribution of adopted LLM families, and synthesized recurring limitations. The results show that LLM adoption in QSE is predominantly code-centric, with most studies focusing on program synthesis, repair, and refactoring, while lifecycle phases such as requirements engineering, architectural reasoning, and comprehensive validation receive limited attention. Reported challenges include semantic inaccuracies, execution failures on real quantum backends, sensitivity to prompt formulation, and limited domain coverage. Moreover, the empirical landscape is largely shaped by proprietary models, raising concerns regarding reproducibility and longitudinal comparability. Overall, current evidence suggests that LLMs function primarily as assistive tools for bounded tasks rather than as robust, lifecycle-spanning engineering agents in quantum software development.
This study evaluates a protocol-guided large language model (LLM) agent workflow for quantum program synthesis and execution. A versioned YAML protocol specifies interface and quantum-semantic requirements while leaving circuit design to the model. The workflow combines Qiskit circuit generation, evaluator-guided repair, and quantum processing unit (QPU) deployment. A matched ablation evaluates four LLM endpoints using the variational quantum eigensolver (VQE) for H2_22​, the quantum approximate optimization algorithm (QAOA) for MaxCut, and Fashion-MNIST quantum-kernel classification. Across 240 trials, protocol guidance increased evaluator completion from 80.0\% to 99.2\%, reduced mean repairs from 2.56 to 0.75, and reduced mean agent time from 55.70 to 30.58~s. Provider-reported token use decreased for three of four endpoints. Completed VQE trials meeting chemical accuracy increased from 16/40 to 29/40, while valid QAOA approximation ratios remained comparable. Semantic review identified rank-one fidelity kernels, reinforcing the distinction between evaluator completion and semantic validity. A 210-run IBM QPU study evaluated the combined generation-and-selection pipelines and confirmed deployment feasibility. The results support protocol guidance as a software-reliability layer that must be complemented by quantum-semantic validation.
Large language models (LLMs) have demonstrated good performance in general code generation; however, their capabilities in quantum code generation remain insufficiently studied. This paper presents QuanBench, a benchmark for evaluating LLMs on quantum code generation. QuanBench includes 44 programming tasks that cover quantum algorithms, state preparation, gate decomposition, and quantum machine learning. Each task has an executable canonical solution and is evaluated by functional correctness (Pass@K) and quantum semantic equivalence (Process Fidelity). We evaluate several recent LLMs, including general-purpose and code-specialized models. The results show that current LLMs have limited capability in generating the correct quantum code, with overall accuracy below 40% and frequent semantic errors. We also analyze common failure cases, such as outdated API usage, circuit construction errors, and incorrect algorithm logic. QuanBench provides a basis for future work on improving quantum code generation with LLMs.
As quantum computing emerges as a powerful tool for solving combinatorial optimization problems, the absence of intuitive programming interfaces remains a major barrier to practical adoption. This work presents a secure and resilient natural language interface that translates high-level optimization prompts into QUBO (Quadratic Unconstrained Binary Optimization) formulations suitable for quantum solvers such as D-Wave. The translation pipeline leverages large language models (LLMs) and incorporates multiple verification layers, including schema validation, constraint compliance checks, and reverse translation for semantic fidelity auditing. Fidelity is quantified using cosine similarity between sentence embeddings of the original and reconstructed problem descriptions, enabling intent alignment analysis. We evaluate the system across 100 optimization instances spanning five canonical problem types: Knapsack, Traveling Salesman Problem, Graph Coloring, Seating Assignment, and Team Assignment. Results show that GPT-4 significantly outperforms GPT-3.5 in complex cases such as TSP, achieving up to90%90\%90%success rates where earlier models fail entirely. Latency measurements confirm interactive performance, with most translations completing in under 6 seconds. These results demonstrate the feasibility of trustworthy natural language interfaces for quantum optimization and provide a framework for verifiable, interpretable, and efficient translation from user intent to quantum-executable code.