AI scientists are expanding automated research across scientific domains, yet their ability to turn the scientific record into a foundation for autonomous discovery remains elusive. Here we uncover a fundamental barrier to this transition and demonstrate a route to overcome it in computational quantum science, where advances shape both what we can learn from complex quantum systems and what quantum computing can ultimately deliver. To identify this barrier, we introduce OmniQ, an expert-audited virtual research environment that converts published studies into executable reproduction tasks. Across 59 papers spanning classical simulation, quantum algorithms and quantum-property characterization, we systematically evaluate five agentic systems powered by large language models and six third-party agent harnesses. Our findings reveal that current AI scientists often fail to reproduce published results, exposing a fundamental mismatch between what scientific papers communicate and what autonomous agents require. By contrast, human expert intervention can turn these failures into successful reproductions, showing that the missing information can be identified and converted into reusable research experience. Guided by this observation, we develop Residual Agents (RA), a quantum-tailored self-improving AI scientist that distils externally verified workflow repairs into such experience. RA substantially improves research performance under fixed base models and limited adaptation budgets. For example, RA raises DeepSeek V4.1 Flash performance from 68% to 85%, matching Claude Code with Opus 5 at a third of its cost despite using a weaker base model. We integrate all reproduced results into an extensible platform built on the model context protocol, making verified research workflows directly accessible to AI scientists and allowing new scientific papers to be continuously incorporated.
AI Summary
The paper asks whether LLM-based agents can reconstruct computational quantum-science results from published papers, and whether verified reproduction failures can supply reusable research experience. It introduces OmniQ, an expert-audited environment containing figure-reproduction tasks from 60 papers across classical simulation, quantum algorithms, and quantum-property characterization, selected for execution within approximately one day per task.
Evaluation combines automated inspection of code, logs, data, and numerical checkpoints with cross-agent auditing and expert review. Issues are identified in 18 tasks, ranging from missing methodological details and errors in benchmark specifications to paper–code discrepancies. One unresolved case is excluded, leaving 59 tasks after corrections. In that case, a reported kernel variance reaches $0.49$, exceeding the $0.25$ upper bound for a quantity in $[0,1]$; the released code instead computes a distance variance. On the cleaned benchmark, reported agent success rates range from approximately 19% to 93%.
Residual Agents adds planner–executor–critic coordination and external memories distilled from expert-verified repairs, without changing model weights. Developed using five challenging tasks, with 54 remaining unseen, it raises DeepSeek V4.1 Flash success from 68% to approximately 85%, at an average inference cost of $5.6 per task. The aggregate score includes development tasks.
The study addresses reproduction rather than new algorithm discovery. Its scope excludes many computationally intensive studies, adaptation requires human approval, and some corrected tasks assess qualitative conclusions rather than original numerical values. Fully reliable reproduction, broader disciplinary coverage, and extension to autonomous discovery remain future directions.
Some signs of AI-generated textOverclaimsUnclear noveltyMissing comparison
Central claim may not hold: The paper characterizes all 18 audited studies as having scientific-record inconsistencies even though its audit table includes errors introduced by its own task specifications and grading criteria.
The headline 68%-to-85% comparison includes five development tasks rather than reporting an exclusively held-out rate, although the aggregate counts still imply substantial held-out improvement.
The presented RA-versus-DSH comparison changes both orchestration and experience memory, so it does not isolate reusable verified repairs as the cause of the performance gain.
Written by gpt-6.1-sol from the paper's full text. Automated: it can be wrong.
AI scientists are expanding automated research across scientific domains, yet their ability to turn the scientific record into a foundation for autonomous discovery remains elusive. Here we uncover a fundamental barrier to this transition and demonstrate a route to overcome it in computational quantum science, where advances shape both what we can learn from complex quantum systems and what quantum computing can ultimately deliver. To identify this barrier, we introduce OmniQ, an expert-audited virtual research environment that converts published studies into executable reproduction tasks. Across 59 papers spanning classical simulation, quantum algorithms and quantum-property characterization, we systematically evaluate five agentic systems powered by large language models and six third-party agent harnesses. Our findings reveal that current AI scientists often fail to reproduce published results, exposing a fundamental mismatch between what scientific papers communicate and what autonomous agents require. By contrast, human expert intervention can turn these failures into successful reproductions, showing that the missing information can be identified and converted into reusable research experience. Guided by this observation, we develop Residual Agents (RA), a quantum-tailored self-improving AI scientist that distils externally verified workflow repairs into such experience. RA substantially improves research performance under fixed base models and limited adaptation budgets. For example, RA raises DeepSeek V4.1 Flash performance from 68% to 85%, matching Claude Code with Opus 5 at a third of its cost despite using a weaker base model. We integrate all reproduced results into an extensible platform built on the model context protocol, making verified research workflows directly accessible to AI scientists and allowing new scientific papers to be continuously incorporated.
The paper asks whether LLM-based agents can reconstruct computational quantum-science results from published papers, and whether verified reproduction failures can supply reusable research experience. It introduces OmniQ, an expert-audited environment containing figure-reproduction tasks from 60 papers across classical simulation, quantum algorithms, and quantum-property characterization, selected for execution within approximately one day per task.
Evaluation combines automated inspection of code, logs, data, and numerical checkpoints with cross-agent auditing and expert review. Issues are identified in 18 tasks, ranging from missing methodological details and errors in benchmark specifications to paper–code discrepancies. One unresolved case is excluded, leaving 59 tasks after corrections. In that case, a reported kernel variance reaches 0.49, exceeding the 0.25 upper bound for a quantity in [0,1]; the released code instead computes a distance variance. On the cleaned benchmark, reported agent success rates range from approximately 19% to 93%.
Residual Agents adds planner–executor–critic coordination and external memories distilled from expert-verified repairs, without changing model weights. Developed using five challenging tasks, with 54 remaining unseen, it raises DeepSeek V4.1 Flash success from 68% to approximately 85%, at an average inference cost of $5.6 per task. The aggregate score includes development tasks.
The study addresses reproduction rather than new algorithm discovery. Its scope excludes many computationally intensive studies, adaptation requires human approval, and some corrected tasks assess qualitative conclusions rather than original numerical values. Fully reliable reproduction, broader disciplinary coverage, and extension to autonomous discovery remain future directions.
Quantum computers are moving from research laboratories to industrial machines accessible via the cloud and integrated into high-performance computing facilities. However, translating theoretical quantum protocols into hardware experiments remains a major bottleneck, requiring expertise across protocol design, compilation, simulation, and cloud execution. Here, we introduce an agentic workflow that automates this pipeline on neutral-atom quantum processors (here two Pasqal QPUs available on the cloud) while keeping the researcher in the loop for critical validation. In three case studies from many-body physics and optimization, the agent went from published paper or patent to a QPU campaign run overnight. In particular, human intervention was crucial to ensure scientific validity: the agent selected an inadequate observable in one experiment and constructed a plausible but incorrect hardware diagnosis in another, with both failures detected only through domain-expert review. Finally, we use a second agent to classify a corpus of 633 Rydberg-array arXiv papers and show that nearly half are implementable on present-day QPUs while identifying specific hardware upgrades needed for the rest. Together, these results demonstrate that agentic workflows provide a practical bridge between theoretical ideas and physical hardware, opening quantum experimentation to a much broader scientific community.
We demonstrate that large language model (LLM) agents can autonomously perform tensor network simulations of quantum many-body systems, achieving approximately 90% success rate across representative benchmark tasks. Tensor network methods are powerful tools for quantum simulation, but their effective use requires expertise typically acquired through years of graduate training. By combining in-context learning with curated documentation and multi-agent decomposition, we create autonomous AI agents that can be trained in specialized computational domains within minutes. We benchmark three configurations (baseline, single-agent with in-context learning, and multi-agent with in-context learning) on problems spanning quantum phase transitions, open quantum system dynamics, and photochemical reactions. Systematic evaluation using DeepSeek-V3.2, Gemini 2.5 Pro, and Claude Opus 4.5 demonstrates that both in-context learning and multi-agent architecture are essential. Analysis of failure modes reveals characteristic patterns across models, with the multi-agent configuration substantially reducing implementation errors and hallucinations compared to simpler architectures.
Fully automated self-driving laboratories promise high-throughput, large-scale scientific discovery by reducing repetitive labor. However, they require deep integration of laboratory knowledge, which is often unstructured, multimodal, and hard to incorporate into current AI systems. This paper introduces the "k-agents" framework, designed to support experimentalists in organizing laboratory knowledge and automating experiments with agents. The framework uses large-language-model-based agents to encapsulate laboratory knowledge, including available operations and methods for analyzing results. To automate experiments, execution agents break multistep procedures into agent-based state machines, interact with other agents to execute steps, and analyze results. These results drive state transitions, enabling closed-loop feedback control. We demonstrate the system on a superconducting quantum processor, where agents autonomously planned and executed experiments for hours, successfully producing and characterizing entangled quantum states at human-level performance. Our knowledge-based agent system opens new possibilities for managing laboratory knowledge and accelerating scientific discovery.
The integration of large language models (LLMs) into scientific research is accelerating the realization of autonomous ``AI Scientists.'' While recent advancements have empowered AI to formulate hypotheses and design experiments, a critical gap remains in the execution of these tasks, particularly in the domain of quantum computing (QC). Executing quantum algorithms requires not only generating code but also managing complex computational resources such as QPUs and high-performance computing (HPC) clusters. In this paper, we propose an AI-driven framework specifically designed to bridge this execution gap through the implementation of a Model Context Protocol (MCP) server. Our system enables an LLM agent to process natural language prompts submitted as part of a job, autonomously executing quantum computing workflows by invoking our tools via the MCP. We demonstrate the framework's capability by performing essential quantum algorithmic primitives, including sampling and computation of expectation values. Key technical contributions include the development of an MCP server for quantum execution, a pipeline for interpreting OpenQASM code, an automated workflow with CUDA-Q for the ABCI-Q hybrid platform, and an asynchronous execution pipeline for remote quantum hardware using the Quantinuum emulator via CUDA-Q. This work validates that AI agents can effectively abstract the complexities of hardware interaction through an MCP-based architecture, thereby facilitating the automation of practical quantum research.
Reliable quantum engineering is essential for turning quantum phenomena into practical technologies. As quantum platforms grow in scale and complexity, their characterization and operation require increasing human effort and coordination. Scientific artificial intelligence agents, which can plan experiments, operate instruments, and analyze observations, offer a promising route towards autonomous quantum engineering. Yet whether current agents can perform reliably in this setting has not been systematically established. To fill this gap, we developed Quantum-Harbor, a virtual laboratory that provides a controlled execution environment for agents to interact with quantum systems. This design enables direct verification of both the actions taken and the conclusions drawn. Building on this framework, we introduce QIQCBench, a benchmark of 49 expert-authored tasks spanning multiple layers including calibration and control, error correction and compilation, sensing and networking. Across 17 frontier agentic systems, QIQCBench reveals wide variation in verified performance. These results expose a substantial gap between demonstrating capability and achieving reliable operation, and establish Quantum-Harbor as a foundation for measuring progress towards verified autonomy in quantum engineering.
Researchers at the French quantum computing company PASQAL have unveiled an AI agentic workflow that takes a paper or a patent as input and automatically designs, validates, and executes experiments on a neutral-atom quantum computer. Across three case studies the agent carried campaigns on real quantum processing units (QPUs) from source document to overnight run, demonstrating outstanding engineering capability. It also showed critical limitations, selecting a physically inadequate observable in one case and misdiagnosing a software bug as a hardware fault in another. Both failures were caught only through review by a domain expert. A second agent screened 633 related papers and found that among the 526 it could classify, 258 (49.0 percent) are compatible with present-day hardware, a result the authors use to argue that the bottleneck in quantum research has shifted from engineering to scientific judgment. [Quantum Biology Society] Quantum computers have moved beyond isolated laboratory instruments to become part of cloud-accessible high-performance computing infrastructure. But having access to the hardware does not automatically translate into a meaningful experiment. Running a published theoretical protocol on an actual QPU means passing through a long chain of expertise spanning quantum physics, software engineering, numerical simulation, cloud computing, and hardware characterization. Because of this implementation barrier, physically viable proposals are routinely left unexplored, asleep in the literature. A paper posted to the preprint repository arXiv in July 2026 by a team at PASQAL describes an ambitious attempt to dismantle that barrier using AI agents built on large language models (LLMs). The researchers constructed an automated workflow running from a natural-language prompt all the way to execution on a real QPU, and applied it to problems in many-body physics and optimization. The real value of the work, however, does not lie in the success of the automation. Through the plausible-looking errors the AI committed along the way, the authors make a sharp point: final scientific judgment still belongs to the researcher in the loop. ■ The Agentic Workflow: From Paper to Hardware Control PASQAL's neutral-atom quantum computers excite individually controlled atoms into Rydberg states to realize an Ising-like Hamiltonian. An experimental protocol comes down to three control handles: the atomic register, the Rabi frequency, and the detuning of the driving laser. The AI workflow the researchers built, using Anthropic's Claude Code with the Opus 4.8 and Fable 5 models, sits on top of PASQAL's open-source Python library Pulser, its emulators, and its Cloud SDK. The agent is organized as six modular skills that extract an experimental specification from a paper or patent, compile it into a pulse sequence, validate it through emulation, and submit it to real hardware, namely the FC1 device in Canada and SA1 in Saudi Arabia. Everything is structured around a single file, experiment_spec.json, so that the researcher can inspect and revise the agent's work at any point. A safety gate is built in as well: no protocol reaches the actual device without first passing noiseless and noise-aware emulation. ■ Competence, and a Costly Case of Cognitive Narrowing The researchers tested the agent's performance through three case studies. The first was a reproduction of the Kibble-Zurek mechanism experiment reported in Nature in 2019. The team deliberately instructed the agent to reproduce a phase (Z3) that current hardware cannot reach. After analyzing the live device specification, the agent returned an accurate physical verdict, reasoning that reaching the target regime at the minimum atomic spacing would force the Rabi frequency down so far that neither one Rabi period nor the nearest-neighbour interaction time would fit inside the sequence limit, and it redirected the target to the Z2 phase. In under an hour, and after three researcher prompts, it had jobs submitted to a real QPU and was returning good data. Notably, though, the higher-level moves that improved the result, switching from an open chain to a ring register and extending the study to the second QPU, came from the researcher rather than the agent. The limits of the AI emerged in the second case, the realization of magnetic phases in a triangular Rydberg array. Its verdict on hardware feasibility was flawless, but in choosing observables the agent displayed what the authors call cognitive narrowing, retaining only the structure factor and the mean magnetisation out of the four observables detailed in the original paper. The mean magnetisation is not the one-body order parameter of that paper and cannot distinguish the particular ordering pattern from any other state at the same density, yet the pipeline ran smoothly and the data looked plausible. The flaw surfaced only after the domain expert examined the results directly. With the researcher stepping in to designate the staggered magnetisation as the appropriate observable, and after 43 exchanges in total, physically meaningful QPU data were finally obtained on registers of 49 and 100 atoms. The third case was the implementation of a graph-coloring algorithm taken from a PASQAL patent. Here the agent showed formidable software engineering ability, working out through iterative back-and-forth with the user a scheme in which the full register is compiled once and each round is submitted as a separate job inside a single open batch, eliminating re-queuing latency between rounds while holding just one QPU queue slot. But when constraint-violating shots began appearing at an unexpectedly high rate, the agent confidently attributed them to hardware physics, diagnosing substantial Rydberg-blockade leakage on the QPU. The true cause was a simple data-labelling bug: a mismatch between the ordering of the atomic coordinates and the ordering of the measured bitstrings. Without expert scrutiny, this too could have been written off as a hardware defect. ■ Screening 633 Papers: Roughly Half of the Literature Is Ready for Today's Hardware The final part of the paper takes a wider view. A separate, lighter agent screened arXiv for Rydberg-array theory papers and assessed, quantitatively, how far each could be realized on current hardware. The search identified 633 papers, of which 107 could not be reliably classified. Among the 526 that could, 258 (49.0 percent) were judged compatible with publicly available PASQAL devices; 225 of these describe protocols complete enough to translate directly into executable form, while 33 need modest adaptation such as specifying an observable or a parameter range. Of the 268 papers that are not currently implementable, roughly 85 percent fail on the absence of XY-type interactions (141 papers) or local addressing (87 papers). The analysis shows both that today's quantum hardware has reached a level capable of absorbing a substantial body of theoretical proposals, and where future hardware development is most in demand. ■ Significance and Outlook: The Bottleneck Has Shifted from Engineering to Scientific Judgment This paper is still a preprint and has not been peer reviewed, but its message is unambiguous. AI agents proved overwhelmingly capable at dismantling the engineering barriers of quantum computing experiments, coordinating device interfaces, compiling code, and validating through simulation. Paradoxically, though, as the engineering effort falls away the researcher's role becomes more important than ever. Choosing a physically correct observable, bringing to bear the tacit knowledge that never appears on the page, and critically assessing whether a measured signal genuinely supports a physical claim remain, in the authors' words, irreducibly human. The two failures documented here make that point painfully well. In sum, this work shows that AI can dramatically lower the barrier to entry for quantum computing experiments while reaffirming the value of the human in the loop as the arbiter of scientific truth. Papers that once sat as static text are beginning to turn into executable scientific artifacts, and a new paradigm for quantum research is opening up. #QuantumComputing #NeutralAtoms #RydbergArrays #AIAgents #AgenticWorkflow #AutomatedScience #HumanInTheLoop #QuantumSimulation #CombinatorialOptimization #PASQAL #arXivPreprint Original paper (arXiv preprint): https://arxiv.org/abs/2607.25834 Related coverage (Nature, 19 August 2026): https://www.nature.com/articles/d41586-026-02495-4