Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2504.03192

A Survey of Quantum Transformers: Architectures, Challenges and Outlooks

Hui Zhang, Qinglin Zhao, MengChu Zhou, Li Feng, Dusit Tao Niyato, Shenggen Zheng, Lin Chen

Published Apr 4, 2025• 0 citations
arXivHTMLPDF

Abstract

Quantum Transformers integrate the representational power of classical Transformers with the computational advantages of quantum computing. Since 2022, research in this area has rapidly expanded, giving rise to diverse technical paradigms and early applications. To address the growing need for consolidation, this paper presents the first comprehensive, systematic, and in-depth survey of quantum Transformer models. First, we delineate the research scope, focusing on improving Transformer parts with quantum methods, and introduce foundational concepts in classical Transformers and quantum machine learning. Then we organize existing studies into two main paradigms: PQC-based and QLA-based, with PQC-based paradigm further divided into QKV-only Quantum Mapping, Quantum Pairwise Attention, Quantum Holistic Attention. and Quantum-Assisted Optimization, analyzing their core mechanisms and architectural traits. We also summarize empirical results that demonstrate preliminary quantum advantages, especially on small-scale tasks or resource-constrained settings. Following this, we examine key technical challenges, such as complexity-resource trade-offs, scalability and generalization limitations, and trainability issues including barren plateaus, and provide potential solutions, including quantumizing classical transformer variants with lower complexity, hybrid designs, and improved optimization strategies. Finally, we propose several promising future directions, e.g., scaling quantum modules into large architectures, applying quantum Transformers to domains with inherently quantum data (e.g., physics, chemistry), and developing theory-driven designs grounded in quantum information science. This survey will help researchers and practitioners quickly grasp the overall landscape of current quantum Transformer research and promote future developments in this emerging field.

DOI
10.48550/arxiv.2504.03192

Related papers

A Comprehensive Survey of Quantum Computing: Principles, Progress, and Prospects for Classical-Quantum Integration

Linnea Whitlow

Quantum computing, grounded in the principles of superposition and entanglement, has emerged as a revolutionary paradigm with the potential to outperform classical systems in specific computational tasks. This paper presents a comprehensive survey of the foundational concepts, algorithmic developments, hardware architectures, and programming ecosystems in quantum computing. We analyze the current progress in key application areas such as cryptography, machine learning, optimization, and quantum chemistry. Furthermore, we review recent advances between 2023 and 2025, including developments in fault-tolerant architectures and quantum error correction. The paper also discusses the significant technical challenges that hinder large-scale practical deployment, including qubit scalability, decoherence, and programming limitations. By synthesizing literature across disciplines, this review aims to provide a holistic understanding of the quantum computing landscape and outline critical directions for future research and integration with classical systems.

Journal of Computer Science and Software Applications•Jun 2, 2025•0 citations

Quantum artificial intelligence: A comprehensive survey

Hanqi Jiang, Yi Pan, Junhao Chen +14 more

Quantum Artificial Intelligence (QAI) has emerged at the nexus of quantum computing and AI, promising to redefine computational frontiers. This survey critically synthesizes the state-of-the- art through 2024, elucidating the profound bidirectional synergy between these fields. We analyze how classical machine learning is accelerating quantum hardware control, circuit optimization, and error correction. Conversely, we assess the potential quantum advantage of algorithms, including variational and kernel-based methods, across domains such as drug discovery, financial modeling, and cybersecurity. Our analysis reveals a critical trade-of between the utility of near-term Noisy Intermediate-Scale Quantum (NISQ) devices and the long-term promise of fault-tolerant architectures. We identify fundamental obstacles to QAI’s advancement, including hardware decoherence, algorithmic barren plateaus, and data-encoding bottlenecks. While QAI’s potential is transformative, achieving practical quantum advantage requires a concerted effort to overcome these core challenges at the hardware-software interface. This work provides a roadmap for navigating the current landscape and prioritizing future research in this rapidly evolving discipline. • We introduce a bi-directional Quantum-AI framework, AI-for-QC and QC-for-AI, and provide a practical roadmap for integrating both paradigms across the full stack. • We quantify AI-enabled gains: calibration time drops from 8 hours to 2 hours, circuit depth falls by up to 42%, and ML decoders cut logical error rates by about half. • We synthesize comparative guidance on VQAs, quantum kernels, and hybrid/quantum Transformers, clarifying trainability limits and criteria for credible quantum advantage. • We deliver a clinically grounded playbook for radiology, covering small-data use cases, plug-in hybrid modules, OOD validation, fairness assessments, and TRIPOD/CONSORT-AI reporting.

Meta-Radiology•Feb 13, 2026•1 citation

Quantum Machine Learning for Robotics: A Comprehensive Review of Algorithms, Applications, and Future Directions

Hassen Nigatu, Gaokun Shi, Jituo Li +2 more

The convergence of quantum computing and robotics represents a paradigm shift in autonomous systems design, promising to overcome fundamental computational limitations that have constrained classical robotic capabilities. This comprehensive review surveys the rapidly evolving field of quantum machine learning (QML) for robotics, systematically analyzing 107 peer-reviewed contributions spanning quantum algorithms, machine learning techniques, and their robotic applications. We provide a detailed historical perspective on the field's development, from the early theoretical foundations established by Grover's search algorithm and quantum reinforcement learning proposals to current experimental implementations on noisy intermediate-scale quantum (NISQ) devices. The review systematically examines five major application domains: (1) quantum reinforcement learning for navigation and control, (2) quantum search and path planning algorithms, (3) quantum-enhanced localization and mapping, (4) quantum optimization for inverse kinematics and task allocation, and (5) multi-robot coordination and swarm intelligence. For each domain, we present detailed algorithmic formulations, computational complexity analyses, and critical assessments of experimental results. Our analysis reveals that while provable quantum advantage in robotics remains largely prospective, recent demonstrations show promising results: quantum deep reinforcement learning achieving 40\% parameter reduction in navigation tasks, Grover-based kinematic optimization demonstrating up to 93x speedups, and quantum annealing providing practical solutions for multi-robot routing. We identify key technical challenges, including barren plateaus in variational circuits, noise-induced performance degradation, and the quantum-classical integration bottleneck. Finally, we outline a strategic roadmap for quantum robotics research, distinguishing near-term opportunities in hybrid algorithms from long-term goals requiring fault-tolerant quantum computation. This paper serves as both an authoritative technical reference and a comprehensive guide for researchers working at the intersection of quantum computing and autonomous systems.

•Jun 30, 2026•0 citations

Quantum Machine Learning: Foundational Principles to Practical Applications

Ashis Kumar Pati, Rajesh Vayyala, Kuldip Mohanty +1 more

Quantum Machine Learning (QML) has emerged as a promising interdisciplinary field that combines quantum computing with machine learning to address complex computational problems. This survey provides a comprehensive overview of the theoretical foundations, unified taxonomy, and key methodologies in QML. We discuss quantum data encoding techniques, variational quantum models, neural-inspired quantum architectures, and quantum data learning approaches, along with their associated challenges and limitations. The survey further examines evaluation strategies, the concept of quantum advantage, and the role of current quantum hardware and software platforms in advancing QML research. In addition, major application domains and the growing importance of trustworthy QML, including interpretability, robustness, and security, are explored. Finally, we highlight open challenges and future research directions to provide insights into the evolving landscape of Quantum Machine Learning.

IEEE Access•Jan 1, 2026•0 citations

A Comprehensive Survey on Quantum Annealing: Applications, Challenges, and Future Research Directions

Rajeshwar Tripathi, Sahil Tomar, Sandeep Kumar

Quantum annealing has emerged as a transformative approach in solving combinatorial optimization problems by leveraging the principles of quantum mechanics. A comprehensive survey of quantum annealing is presented, delineating its foundational concepts, state-of-the-art advancements, and diverse applications across domains such as logistics, finance, machine learning, and energy optimization. Notable contributions include the introduction of a systematic benchmarking framework to evaluate quantum annealing against classical optimization techniques across metrics like time-to-target, scalability, and energy efficiency. Additionally, novel hybrid quantum-classical paradigms and hardware advancements are explored, addressing challenges in qubit connectivity, coherence, and noise resilience. Optimization problems are mapped to suitable quantum annealing platforms, offering practical guidelines for leveraging quantum technologies in real-world scenarios. Critical gaps in scalability and integration with machine learning are identified, with future research directions proposed to bridge these challenges. These findings provide a holistic understanding of quantum annealing's potential, offering a foundational resource for advancing quantum computing in optimization.

•Jan 7, 2025•6 citations

Quantum-Aware Large Language Models: Taxonomy, Architectures, and Future Applications

Reyhan Dede

The convergence of quantum computing and large language models (LLMs) represents a major milestone in computational intelligence, introducing novel paradigms for information processing, complexity modeling, and scientific advancement. This survey provides a comprehensive overview of the emerging interdisciplinary field that integrates quantum mechanics with natural language processing. We begin by presenting the foundational principles of quantum computing and LLMs, then examine their integration through automated quantum code generation, hybrid transformer architectures, and quantum natural language processing (QNLP) frameworks. State-of-the-art models, such as quantum-augmented attention mechanisms and circuit embedding strategies, are evaluated across domain-specific datasets and benchmarks. We also investigate the role of LLMs as quantum research assistants, educational tools, and simulation agents, particularly in resource-constrained environments. Furthermore, the survey explores challenges related to scalability, interpretability, and quantum data encoding, and outlines future research directions-especially the vision for fully quantum-native LLMs. Our goal is to guide researchers through the current landscape and to encourage continued exploration at the intersection of quantum technologies and advanced language models.

International Conference on Electrical, Communication, and Computer Engineering (ICECCE)•Aug 27, 2025•0 citations
Quantum Transformers integrate the representational power of classical Transformers with the computational advantages of quantum computing. Since 2022, research in this area has rapidly expanded, giving rise to diverse technical paradigms and early applications. To address the growing need for consolidation, this paper presents the first comprehensive, systematic, and in-depth survey of quantum Transformer models. First, we delineate the research scope, focusing on improving Transformer parts with quantum methods, and introduce foundational concepts in classical Transformers and quantum machine learning. Then we organize existing studies into two main paradigms: PQC-based and QLA-based, with PQC-based paradigm further divided into QKV-only Quantum Mapping, Quantum Pairwise Attention, Quantum Holistic Attention. and Quantum-Assisted Optimization, analyzing their core mechanisms and architectural traits. We also summarize empirical results that demonstrate preliminary quantum advantages, especially on small-scale tasks or resource-constrained settings. Following this, we examine key technical challenges, such as complexity-resource trade-offs, scalability and generalization limitations, and trainability issues including barren plateaus, and provide potential solutions, including quantumizing classical transformer variants with lower complexity, hybrid designs, and improved optimization strategies. Finally, we propose several promising future directions, e.g., scaling quantum modules into large architectures, applying quantum Transformers to domains with inherently quantum data (e.g., physics, chemistry), and developing theory-driven designs grounded in quantum information science. This survey will help researchers and practitioners quickly grasp the overall landscape of current quantum Transformer research and promote future developments in this emerging field.
Quantum computing, grounded in the principles of superposition and entanglement, has emerged as a revolutionary paradigm with the potential to outperform classical systems in specific computational tasks. This paper presents a comprehensive survey of the foundational concepts, algorithmic developments, hardware architectures, and programming ecosystems in quantum computing. We analyze the current progress in key application areas such as cryptography, machine learning, optimization, and quantum chemistry. Furthermore, we review recent advances between 2023 and 2025, including developments in fault-tolerant architectures and quantum error correction. The paper also discusses the significant technical challenges that hinder large-scale practical deployment, including qubit scalability, decoherence, and programming limitations. By synthesizing literature across disciplines, this review aims to provide a holistic understanding of the quantum computing landscape and outline critical directions for future research and integration with classical systems.
Quantum Artificial Intelligence (QAI) has emerged at the nexus of quantum computing and AI, promising to redefine computational frontiers. This survey critically synthesizes the state-of-the- art through 2024, elucidating the profound bidirectional synergy between these fields. We analyze how classical machine learning is accelerating quantum hardware control, circuit optimization, and error correction. Conversely, we assess the potential quantum advantage of algorithms, including variational and kernel-based methods, across domains such as drug discovery, financial modeling, and cybersecurity. Our analysis reveals a critical trade-of between the utility of near-term Noisy Intermediate-Scale Quantum (NISQ) devices and the long-term promise of fault-tolerant architectures. We identify fundamental obstacles to QAI’s advancement, including hardware decoherence, algorithmic barren plateaus, and data-encoding bottlenecks. While QAI’s potential is transformative, achieving practical quantum advantage requires a concerted effort to overcome these core challenges at the hardware-software interface. This work provides a roadmap for navigating the current landscape and prioritizing future research in this rapidly evolving discipline. • We introduce a bi-directional Quantum-AI framework, AI-for-QC and QC-for-AI, and provide a practical roadmap for integrating both paradigms across the full stack. • We quantify AI-enabled gains: calibration time drops from 8 hours to 2 hours, circuit depth falls by up to 42%, and ML decoders cut logical error rates by about half. • We synthesize comparative guidance on VQAs, quantum kernels, and hybrid/quantum Transformers, clarifying trainability limits and criteria for credible quantum advantage. • We deliver a clinically grounded playbook for radiology, covering small-data use cases, plug-in hybrid modules, OOD validation, fairness assessments, and TRIPOD/CONSORT-AI reporting.
The convergence of quantum computing and robotics represents a paradigm shift in autonomous systems design, promising to overcome fundamental computational limitations that have constrained classical robotic capabilities. This comprehensive review surveys the rapidly evolving field of quantum machine learning (QML) for robotics, systematically analyzing 107 peer-reviewed contributions spanning quantum algorithms, machine learning techniques, and their robotic applications. We provide a detailed historical perspective on the field's development, from the early theoretical foundations established by Grover's search algorithm and quantum reinforcement learning proposals to current experimental implementations on noisy intermediate-scale quantum (NISQ) devices. The review systematically examines five major application domains: (1) quantum reinforcement learning for navigation and control, (2) quantum search and path planning algorithms, (3) quantum-enhanced localization and mapping, (4) quantum optimization for inverse kinematics and task allocation, and (5) multi-robot coordination and swarm intelligence. For each domain, we present detailed algorithmic formulations, computational complexity analyses, and critical assessments of experimental results. Our analysis reveals that while provable quantum advantage in robotics remains largely prospective, recent demonstrations show promising results: quantum deep reinforcement learning achieving 40\% parameter reduction in navigation tasks, Grover-based kinematic optimization demonstrating up to 93x speedups, and quantum annealing providing practical solutions for multi-robot routing. We identify key technical challenges, including barren plateaus in variational circuits, noise-induced performance degradation, and the quantum-classical integration bottleneck. Finally, we outline a strategic roadmap for quantum robotics research, distinguishing near-term opportunities in hybrid algorithms from long-term goals requiring fault-tolerant quantum computation. This paper serves as both an authoritative technical reference and a comprehensive guide for researchers working at the intersection of quantum computing and autonomous systems.
Quantum Machine Learning (QML) has emerged as a promising interdisciplinary field that combines quantum computing with machine learning to address complex computational problems. This survey provides a comprehensive overview of the theoretical foundations, unified taxonomy, and key methodologies in QML. We discuss quantum data encoding techniques, variational quantum models, neural-inspired quantum architectures, and quantum data learning approaches, along with their associated challenges and limitations. The survey further examines evaluation strategies, the concept of quantum advantage, and the role of current quantum hardware and software platforms in advancing QML research. In addition, major application domains and the growing importance of trustworthy QML, including interpretability, robustness, and security, are explored. Finally, we highlight open challenges and future research directions to provide insights into the evolving landscape of Quantum Machine Learning.
Quantum annealing has emerged as a transformative approach in solving combinatorial optimization problems by leveraging the principles of quantum mechanics. A comprehensive survey of quantum annealing is presented, delineating its foundational concepts, state-of-the-art advancements, and diverse applications across domains such as logistics, finance, machine learning, and energy optimization. Notable contributions include the introduction of a systematic benchmarking framework to evaluate quantum annealing against classical optimization techniques across metrics like time-to-target, scalability, and energy efficiency. Additionally, novel hybrid quantum-classical paradigms and hardware advancements are explored, addressing challenges in qubit connectivity, coherence, and noise resilience. Optimization problems are mapped to suitable quantum annealing platforms, offering practical guidelines for leveraging quantum technologies in real-world scenarios. Critical gaps in scalability and integration with machine learning are identified, with future research directions proposed to bridge these challenges. These findings provide a holistic understanding of quantum annealing's potential, offering a foundational resource for advancing quantum computing in optimization.
The convergence of quantum computing and large language models (LLMs) represents a major milestone in computational intelligence, introducing novel paradigms for information processing, complexity modeling, and scientific advancement. This survey provides a comprehensive overview of the emerging interdisciplinary field that integrates quantum mechanics with natural language processing. We begin by presenting the foundational principles of quantum computing and LLMs, then examine their integration through automated quantum code generation, hybrid transformer architectures, and quantum natural language processing (QNLP) frameworks. State-of-the-art models, such as quantum-augmented attention mechanisms and circuit embedding strategies, are evaluated across domain-specific datasets and benchmarks. We also investigate the role of LLMs as quantum research assistants, educational tools, and simulation agents, particularly in resource-constrained environments. Furthermore, the survey explores challenges related to scalability, interpretability, and quantum data encoding, and outlines future research directions-especially the vision for fully quantum-native LLMs. Our goal is to guide researchers through the current landscape and to encourage continued exploration at the intersection of quantum technologies and advanced language models.