H-DMAtt: Quantum-Native Spectral Attention (english version) Density-Matrix Architecture for Hybrid Quantum Circuits and Energy-Efficient Information Processing Dr. Theodor HeutschiIndependent Researcher, Lucerne, SwitzerlandDate: 15. November 2026 AbstractThis study develops Heutschi Density Matrix Attention (H-DMAtt) from a mathematically controlled, quantum-inspired diagnostic of Transformer self-attention into a testable framework for quantum-native information processing. First, attention distributions are embedded into normalized complex amplitudes and represented by a positive-semidefinite, unit-trace Gram density matrix. Spectral entropy, purity and effective dimension are then used as diagnostic quantities; their empirical usefulness remains subject to reproducible comparisons with classical attention statistics. The formulation distinguishes formal quantum analogies from physically prepared quantum states. Building on overlap identities and phase-gauge invariance, the study specifies qubit-register state preparation, ensemble purification, SWAP-based purity estimation, quantum channels, noise models, quantum Fisher information and hybrid quantum–classical training objectives. Its principal extension is quantum-native H-DMAtt (QN-H-DMAtt): states supplied directly by a quantum sensor, simulator or parameterized circuit are analysed through selected spectral moments and observables without first loading an arbitrary classical attention matrix. An adaptive measurement controller allocates shots according to explicit statistical confidence criteria and feeds a limited set of estimates into a classical attention or decision layer. The work derives operational measurement bounds and a resource accounting framework that includes preparation, circuit depth, sampling, readout, communication and error mitigation. The architecture also investigates reduced circuit complexity, adaptive measurement budgets and task-level energy efficiency. For selected tasks, a two- to five-fold reduction in time-to-solution is specified as an ambitious, unverified performance target, alongside an experimental objective of at least 20% lower task-attributable energy consumption relative to optimized implementations on identical hardware. These figures are research targets rather than measured results or calibrated forecasts; they require validation under matched accuracy, confidence and system-energy boundaries. Original Transformer pilot results are retained as preliminary, unverified reports; no speedup or energy advantage over optimized classical or quantum baselines is claimed. The contribution is a falsifiable architecture and experimental protocol for determining when quantum-native spectral attention is useful.
H-DMAtt: Quantum-Native Spectral Attention (english version) Density-Matrix Architecture for Hybrid Quantum Circuits and Energy-Efficient Information Processing Dr. Theodor HeutschiIndependent Researcher, Lucerne, SwitzerlandDate: 15. November 2026 AbstractThis study develops Heutschi Density Matrix Attention (H-DMAtt) from a mathematically controlled, quantum-inspired diagnostic of Transformer self-attention into a testable framework for quantum-native information processing. First, attention distributions are embedded into normalized complex amplitudes and represented by a positive-semidefinite, unit-trace Gram density matrix. Spectral entropy, purity and effective dimension are then used as diagnostic quantities; their empirical usefulness remains subject to reproducible comparisons with classical attention statistics. The formulation distinguishes formal quantum analogies from physically prepared quantum states. Building on overlap identities and phase-gauge invariance, the study specifies qubit-register state preparation, ensemble purification, SWAP-based purity estimation, quantum channels, noise models, quantum Fisher information and hybrid quantum–classical training objectives. Its principal extension is quantum-native H-DMAtt (QN-H-DMAtt): states supplied directly by a quantum sensor, simulator or parameterized circuit are analysed through selected spectral moments and observables without first loading an arbitrary classical attention matrix. An adaptive measurement controller allocates shots according to explicit statistical confidence criteria and feeds a limited set of estimates into a classical attention or decision layer. The work derives operational measurement bounds and a resource accounting framework that includes preparation, circuit depth, sampling, readout, communication and error mitigation. The architecture also investigates reduced circuit complexity, adaptive measurement budgets and task-level energy efficiency. For selected tasks, a two- to five-fold reduction in time-to-solution is specified as an ambitious, unverified performance target, alongside an experimental objective of at least 20% lower task-attributable energy consumption relative to optimized implementations on identical hardware. These figures are research targets rather than measured results or calibrated forecasts; they require validation under matched accuracy, confidence and system-energy boundaries. Original Transformer pilot results are retained as preliminary, unverified reports; no speedup or energy advantage over optimized classical or quantum baselines is claimed. The contribution is a falsifiable architecture and experimental protocol for determining when quantum-native spectral attention is useful.
H-DMAtt: Quantum-Native Spectral Attention Density-Matrix Architecture for Hybrid Quantum Circuits and Energy-Efficient Information Processing Dr. Theodor HeutschiIndependent Researcher, Lucerne, SwitzerlandDate: 15. November 2026 Abstract (English)This study develops Heutschi Density Matrix Attention (H-DMAtt) from a mathematically controlled, quantum-inspired diagnostic of Transformer self-attention into a testable framework for quantum-native information processing. First, attention distributions are embedded into normalized complex amplitudes and represented by a positive-semidefinite, unit-trace Gram density matrix. Spectral entropy, purity and effective dimension are then used as diagnostic quantities; their empirical usefulness remains subject to reproducible comparisons with classical attention statistics. The formulation distinguishes formal quantum analogies from physically prepared quantum states. Building on overlap identities and phase-gauge invariance, the study specifies qubit-register state preparation, ensemble purification, SWAP-based purity estimation, quantum channels, noise models, quantum Fisher information and hybrid quantum–classical training objectives. Its principal extension is quantum-native H-DMAtt (QN-H-DMAtt): states supplied directly by a quantum sensor, simulator or parameterized circuit are analysed through selected spectral moments and observables without first loading an arbitrary classical attention matrix. An adaptive measurement controller allocates shots according to explicit statistical confidence criteria and feeds a limited set of estimates into a classical attention or decision layer. The work derives operational measurement bounds and a resource accounting framework that includes preparation, circuit depth, sampling, readout, communication and error mitigation. The architecture also investigates reduced circuit complexity, adaptive measurement budgets and task-level energy efficiency. For selected tasks, a two- to five-fold reduction in time-to-solution is specified as an ambitious, unverified performance target, alongside an experimental objective of at least 20% lower task-attributable energy consumption relative to optimized implementations on identical hardware. These figures are research targets rather than measured results or calibrated forecasts; they require validation under matched accuracy, confidence and system-energy boundaries. Original Transformer pilot results are retained as preliminary, unverified reports; no speedup or energy advantage over optimized classical or quantum baselines is claimed. The contribution is a falsifiable architecture and experimental protocol for determining when quantum-native spectral attention is useful. Zusammenfassung (Deutsch)Diese Arbeit entwickelt die Heutschi Density Matrix Attention (H-DMAtt) von einer mathematisch kontrollierten, quanteninspirierten Diagnostik der Transformer-Self-Attention zu einem überprüfbaren Rahmen für quantennative Informationsverarbeitung weiter. Zunächst werden Attention-Verteilungen in normierte komplexe Amplituden eingebettet und als positivsemidefinite, spurnormierte Gram-Dichtematrix dargestellt. Von-Neumann-Entropie, Reinheit und effektive Dimension dienen als spektrale Diagnosegrössen, deren empirischer Zusatznutzen gegenüber klassischen Attention-Statistiken reproduzierbar zu prüfen ist. Dabei wird die formale Quantenanalogie ausdrücklich von physikalisch präparierten Quantenzuständen unterschieden. Aufbauend auf Überlappidentitäten und Phasen-Gauge-Invarianz spezifiziert die Arbeit Qubit-Zustandspräparation, Ensemble-Purifikation, SWAP-basierte Reinheitsschätzung, Quantenkanäle, Rauschmodelle, Quantum Fisher Information und hybride quantenklassische Trainingsziele. Die zentrale Erweiterung ist die quantennative H-DMAtt (QN-H-DMAtt): Direkt aus Quantensensoren, Quantensimulatoren oder parametrisierten Schaltungen erzeugte Zustände werden anhand ausgewählter Spektralmomente und Observablen analysiert, ohne zuvor eine beliebige klassische Attention-Matrix als Amplituden laden zu müssen. Ein adaptiver Messcontroller verteilt Messwiederholungen nach expliziten statistischen Konfidenzkriterien und übergibt wenige Schätzgrössen an eine klassische Attention- oder Entscheidungsschicht. Hergeleitet werden operationale Messschranken und ein Ressourcenmodell mit Präparation, Schaltungstiefe, Sampling, Auslesung, Kommunikation und Fehlerbehandlung. Die Architektur untersucht darüber hinaus verringerte Schaltungskomplexität, adaptive Messbudgets und aufgabenbezogene Energieeffizienz. Für ausgewählte Aufgaben wird eine zwei- bis fünffache Verbesserung der Zeit bis zur Lösung als ambitioniertes, bislang unbestätigtes Leistungsziel formuliert; ergänzend wird eine Senkung des aufgabenbezogenen Energieverbrauchs um mindestens 20 % gegenüber optimierten Referenzimplementierungen auf identischer Hardware als experimentelles Ziel untersucht. Diese Werte sind Forschungsziele, keine Messergebnisse oder statistisch kalibrierten Prognosen; ihre Überprüfung erfordert gleiche Genauigkeit, Konfidenz und Systemgrenzen der Energiemessung. Die ursprünglichen Transformer-Pilotwerte bleiben als vorläufige, nicht unabhängig bestätigte Angaben dokumentiert; ein Geschwindigkeits- oder Energievorteil gegenüber optimierten klassischen oder quantenbasierten Baselines wird nicht behauptet. Das Ergebnis ist eine falsifizierbare Architektur samt Experimentprotokoll zur Prüfung quantennativer spektraler Attention.
Quantum-Inspired Spectral Attention: A Density Matrix Formulation for Transformer Diagnostics and the Heutschi Density Matrix Attention (H-DMAtt) Quanteninspirierte Zustandsräume und spektrale Diagnostik als rigorose Erweiterung der Transformer-Architektur Dr. Theodor Heutschi Date: August 2026 Abstract Self-attention in Transformer models is traditionally understood as a normalised scalar product. This paper presents a mathematically rigorous, quantum-inspired reformulation as a density matrix in the token Hilbert space. In contrast to earlier approaches, it is shown that a naïve symmetrisation of the attention matrix generally does not yield a valid density matrix. As a solution, we introduce a construction based on state amplitudes that is guaranteed to be Hermitian, positive semi-definite and trace-normalised. Building on this, we define the Heutschi Density Matrix Attention (H-DMAtt) - an architectural module that utilises complex-valued state vectors. At runtime, the module computes the von Neumann entropy S(ρ) and the effective dimension D_𝑒𝑓𝑓. We present a controlled benchmark protocol with proof-of-concept results. The work explicitly emphasises the analogical nature of the quantum concepts. Abstract Die Self-Attention in Transformer-Modellen wird traditionell als normalisiertes Skalarprodukt verstanden. Die vorliegende Arbeit stellt eine mathematisch rigorose, quanteninspirierte Reformulierung als Dichtematrix im Token-Hilbertraum vor. Im Gegensatz zu früheren Ansätzen wird gezeigt, dass eine naive Symmetrisierung der Attention-Matrix im Allgemeinen keine gültige Dichtematrix liefert. Als Lösung führen wir eine Konstruktion über Zustandsamplituden ein, die garantiert hermitesch, positiv semi-definit und spurnormalisiert ist. Aufbauend darauf definieren wir die Heutschi Density Matrix Attention (H-DMAtt) - ein Architekturmodul, das komplexwertige Zustandsvektoren nutzt. Zur Laufzeit berechnet das Modul die Von-Neumann-Entropie S(ρ) und die effektive Dimension D_𝑒𝑓𝑓 Wir präsentieren ein kontrolliertes Benchmark-Protokoll mit Proof-ofConcept-Ergebnissen. Die Arbeit betont ausdrücklich den analogischen Charakter der Quantenbegriffe.
Abstract A recurring weakness in quantum machine learning (QML) is that reported ‘quantum advantages’ are seldom tested against a capacity-matched classical control, leaving it unclear whether a gain comes from the quantum substrate or from the architectural change that accompanies it. Our primary contribution is methodological: a protocol for attributing such gains honestly—a capacity-matched classical bottleneck of identical parameter budget, transparent reporting of where quantum does not help, and validation on real quantum hardware—which we develop and apply through a concrete case study. That case study is Quantum Adaptive Self-Attention (QASA), a hybrid Transformer that replaces the value projection of a single encoder layer with a 36-parameter parameterized quantum circuit (PQC), keeping all other layers classical. Across nine synthetic benchmarks and the real-world ETTh1 dataset, QASA improves on a full-capacity classical Transformer for chaotic and trend-dominated signals. To ask whether this is a genuinely quantum effect, we introduce a control rarely applied in QML—a capacity-matched classical bottleneck with the same parameter budget—and find that it matches the PQC on the error metrics. The gain is therefore attributable to the low-rank value-projection bottleneck (an architectural parsimony principle), not to quantumness; adding further quantum layers only degrades performance and trainability. We accordingly position the quantum layer not as a source of accuracy advantage but as a competitive instantiation of this principle: its low-rank compression onto the signal’s intrinsic dimensionality is matched by a classical bottleneck, so the gain is architectural rather than quantum. The quantum layer’s distinguishing features are physical—a high circuit entanglement (Meyer–Wallach Q = 0.981 with only 27 CNOTs, which we report as a circuit-level property) and, most concretely, noisy intermediate-scale quantum deployability, which we verify by executing the trained model on a real IBM Quantum processor (one-step prediction within 7.5 % of noiseless simulation on the quantum-favored task and 25 % , with overlapping error bars, on a classical-favored control; no error mitigation). Relative to other quantum sequence models (quantum long short-term memory (QLSTM), QnnFormer), QASA is moreover the most resource-efficient of the three: it reaches competitive accuracy with the fewest quantum parameters (36 vs 90–128) and the strongest entanglement-per-gate ( Q = 0.981 with 27 CNOTs vs QLSTM’s 56), and retains trainable gradients that deeper circuits lose. We argue that capacity-matched baselines and honest reporting of where quantum does not help are prerequisites for credible quantum-machine-learning claims.
The automated design of parameterized quantum circuits for variational algorithms in the NISQ era faces a fundamental limitation, as conventional differentiable architecture search relies on classical models that fail to adequately represent quantum gate interactions under hardware noise. We introduce the Quantum-Based Self-Attention for Differentiable Quantum Architecture Search (QBSA-DQAS), a meta-learning framework featuring quantum-based self-attention and hardware-aware multi-objective search. The framework employs a two-stage quantum self-attention module that computes contextual dependencies by mapping architectural parameters through parameterized quantum circuits, replacing classical similarity metrics with quantum-derived attention scores, then applies position-wise quantum transformations for feature enrichment. Architecture search is guided by a task-agnostic multi-objective function jointly optimizing noisy expressibility and Probability of Successful Trials (PST). A post-search optimization stage applies gate commutation, fusion, and elimination to reduce circuit complexity. Experimental validation demonstrates superior performance on VQE tasks and large-scale Wireless Sensor Networks. For VQE on H2, QBSA-DQAS achieves 0.9 accuracy compared to 0.89 for standard DQAS. Post-search optimization reduces discovered circuit complexity by up to 44% in gate count and 47% in depth without accuracy degradation. The framework maintains robust performance across three molecules and five IBM quantum hardware noise models. For WSN routing, discovered circuits achieve 8.6% energy reduction versus QAOA and 40.7% versus classical greedy methods, establishing the effectiveness of quantum-native architecture search for NISQ applications.
Abstract We formalize Quantum Hybrid Modules (QHM) to evaluate the insertion of quantum subroutines into classical AI pipelines with explicit assumptions about data loading, noise, and measurement overhead. The framework comprises three components: (1) a Hadamard Quantum Self-Attention (HQSA) module computing sparse attention via Hadamard-test inner products in O(nn/k⋅logd/ϵ) time assuming quantum random access memory (qRAM); (2) a Quantum Approximate Optimization Algorithm (QAOA) module for combinatorial optimization sub-problems; and (3) a Grover-accelerated neurosymbolic verification loop for quadratically faster constraint checking. We evaluate QHM through 22 experiments spanning statevector and GPU simulation up to 30 qubits, cloud simulators, and five quantum processing unit (QPU) experiments on Rigetti Cepheus and IonQ Forte, including 8--100-qubit superconducting and 8--30-qubit trapped-ion QAOA. Simulations confirm the intended mechanisms: QAOA exceeds the Goemans--Williamson bound on selected 3-regular instances, Hadamard-test attention reproduces classical softmax, and Grover verification reaches a 20,862× query reduction at 30 qubits. Classical, dequantized, and qRAM-free baselines expose current limits: small quantum kernels lag tuned classical baselines, hybrid variational quantum circuit layers add training cost without consistent accuracy gains, and shot-based noisy intermediate-scale quantum (NISQ) attention is limited by systematic bias. Hardware results are depth- and platform-dependent: shallow circuits retain measurable signal, Rigetti QAOA depolarizes to the random baseline and is not recovered by post-hoc mitigation, and IonQ Forte preserves QAOA signal but remains below noiseless performance. We do not claim near-term quantum advantage; we characterize the gap between asymptotic theory and present-day hardware.
Quantum attention mechanisms integrate parameterised quantum circuits or quantum linear algebra primitives into transformer architectures, drawing on superposition and entanglement in the attention computation. The field has produced more than two dozen proposals between 2022 and 2026, spanning Parameterised Quantum Circuits (PQC) on near-term hardware, Quantum Linear Algebra (QLA) on fault-tolerant hardware, and quantum annealing. This survey contributes a refined taxonomy with an attention-semantics dimension distinguishing pairwise from holistic mechanisms; a resource-realism analysis that states the measurement-overhead cost of pairwise quantum attention in the Noisy Intermediate-Scale Quantum (NISQ) regime as a proposition under explicit assumptions, with the architecture classes falling outside those assumptions identified, organised within a four-axis design framework covering sequence and qubit scaling, circuit depth, encoding overhead, and hardware platform constraints, complementing the dedicated measurement-overhead analysis; and a critical synthesis of the empirical literature that finds parity or task-conditional modest gains rather than uniform quantum advantage across the five papers reporting parameter-matched classical baselines. Six open directions are identified for the next phase of research. The survey clarifies what the current literature does and does not establish about quantum attention’s practical advantage over efficient classical alternatives.