Modern cloud systems demand efficient task scheduling to optimize resource utilization and meet QoS requirements amid unpredictable workloads. Classical Reinforcement Learning (RL) struggles with slow convergence and poor scalability in these complex environments due to exponentially growing state-action spaces. Quantum Reinforcement Learning (QRL) addresses these limitations by exploiting superposition and entanglement to enable parallel policy exploration and faster learning. This survey analyzes recent QRL and quantum-inspired schedulers across cloud, edge, and fog computing, highlighting their superior performance over classical Deep Reinforcement Learning (DRL) baselines in simulated settings. Key findings reveal persistent methodological gaps, including an exclusive reliance on noise-free quantum simulators, an absence of real hardware validation, and limited scalability testing. Future research directions include prioritizing noise-resilient designs, developing hybrid quantum-classical systems for NISQ-era deployment and integrating data-aware scheduling algorithms.
Modern cloud systems demand efficient task scheduling to optimize resource utilization and meet QoS requirements amid unpredictable workloads. Classical Reinforcement Learning (RL) struggles with slow convergence and poor scalability in these complex environments due to exponentially growing state-action spaces. Quantum Reinforcement Learning (QRL) addresses these limitations by exploiting superposition and entanglement to enable parallel policy exploration and faster learning. This survey analyzes recent QRL and quantum-inspired schedulers across cloud, edge, and fog computing, highlighting their superior performance over classical Deep Reinforcement Learning (DRL) baselines in simulated settings. Key findings reveal persistent methodological gaps, including an exclusive reliance on noise-free quantum simulators, an absence of real hardware validation, and limited scalability testing. Future research directions include prioritizing noise-resilient designs, developing hybrid quantum-classical systems for NISQ-era deployment and integrating data-aware scheduling algorithms.
The integration of Quantum-Inspired Reinforcement Learning (QiRL) into Edge-Driven CyberPhysical Systems (CPS) presents a transformative approach to enhance real-time decision-making in distributed environments. While classical reinforcement learning (RL) struggles with scalability and computational complexity in edge-CPS, quantum-inspired Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems algorithms leverage superposition and entanglement principles to optimize policy exploration and convergence. This paper proposes a novel QiRL framework that combines quantum-inspired optimization with deep RL, enabling efficient resource allocation and adaptive control in latency-sensitive applications (e.g., smart grids, autonomous drones). We formalize the mathematical foundations of QiRL, design a hybrid neural-quantum architecture for edge deployment, and evaluate its performance under dynamic CPS constraints. Simulations on IoT-based case studies demonstrate 20−35% faster convergence and 15% higher energy efficiency compared to classical Deep Q-Networks (DQN). Key challenges, such as quantum noise simulation and edge-hardware limitations, are discussed to guide future research. This work bridges quantum computing principles with edge intelligence, offering a scalable pathway for nextgeneration CPS.
Quantum cloud computing, delivered through the quantum-as-a-service (QaaS) model, provides access to quantum computing resources. However, applying uniform time-based pricing across fundamentally heterogeneous quantum resources significantly complicates task orchestration, particularly when addressing the tradeoff between execution costs and system performance. While heuristic methods rely on predefined scheduling rules, classical deep reinforcement learning (DRL) models may require more trainable parameters in this setting. Motivated by the potential of parameterised quantum circuits (PQCs) as compact function approximators, we propose QRLQ, a cost-delay-aware quantum cloud scheduling framework integrating PQCs with a dueling double deep Q-network (D3QN) to dynamically account for both cost and delay. Our simulation results show that QRLQ achieves lower mean cost and delay than the heuristic baselines, achieving a 5-11% lower mean cost relative to availability-based and rotation-based heuristics and reducing mean delay by 17% and 82% relative to the strongest and weakest heuristic baselines, respectively, while retaining execution fidelity within 2% of a fidelity-greedy policy. Compared with the classical DRL baseline, QRLQ achieves comparable scheduling performance while using 72% fewer trainable parameters. This work explores the feasibility of using QRL for task orchestration in quantum cloud environments and demonstrates its potential for cost-delay-aware quantum resource management.
The significant rise in wireless communication, driven by sixth-generation (6G) networks, underscores the urgent need for innovative resource allocation methods to achieve efficiency, scalability, and reliability. This survey explores the integration of Quantum Deep Reinforcement Learning (QDRL) as a strategy to address the challenges posed by dynamic and complex wireless environments. By leveraging quantum computing features such as superposition and entanglement, QDRL enhances computational efficiency and mitigates the scalability limitations of classical and deep reinforcement learning (DRL) in high-dimensional optimization. The study reviews recent QDRL approaches for key resource allocation tasks, including power distribution, user scheduling, and channel assignment, and examines quantum algorithms such as the Quantum Approximate Optimization Algorithm (QAOA) and Quantum Neural Networks (QNN) for improved decision-making in wireless systems. Furthermore, it emphasizes the connection between quantum computing and DRL, highlighting hybrid architectures that balance computational cost, energy efficiency, and scalability. Finally, the survey identifies research gaps and outlines future directions, paving the way for robust QDRL strategies to support next-generation wireless networks.
Abstract: Quantum deep reinforcement learning is an integration of the principles of quantum computing with deep reinforcement learning in an effort to advance robot navigation tasks. Due to the explosion of the state and action spaces, traditionally DRL methods are limited in scalability and efficiency. QDRL, however, uses quantum superposition and entanglement for more efficient processing of big amounts of information-it enables robots to learn optimal policies for navigating complex environments. We introduce here a new QDRL framework in which quantum neural networks encode policy functions and value estimates. We demonstrate how quantum circuits can take advantage of multi-dimensional state representations in order to strengthen the power of a robot in changing its environment over time. Benchmark experiments on navigation tasks reflect phenomenal acceleration in learning performance along with better decision-making accuracy compared to classical DRL methods. We then consider integrating such quantum algorithms, as Grover's search, to improve exploration strategies in sparse reward settings. The experiments show that QDRL speeds up convergence rates and provides robots with the possibility to react more rapidly to unexpected obstacles. It discusses new applications for quantum computing of autonomous systems, potentially applied to robotics, autonomous vehicles, and other environments which require complex decision making. Some lines of work in the future are optimization of the resources needed for quantum computers and hybrid architectures for the resolution of classical problems in navigation
The increasing demands for ultra-reliable low-latency communication (URLLC), high-capacity, connectivity, and mobility in next-generation wireless networks have driven the integration of unmanned aerial vehicles (UAVs) as flexible and adaptive communication nodes. UAV-assisted networks offer enhanced coverage, dynamic deployment, and cost-effective infrastructure for the sixth generation (6G) and beyond. However, optimizing UAV trajectory planning, resource allocation, and interference management is particularly challenging, especially in dynamic and large-scale environments. Classical reinforcement learning (RL) techniques, while effective in adaptive optimization, suffer from computational inefficiencies and slow convergence in high-dimensional state-action spaces. To address these constraints, quantum reinforcement learning (QRL) emerges as a novel paradigm that leverages quantum computing principles, such as superposition and entanglement, to enhance decision-making efficiency. This study provides a comprehensive overview of QRL algorithms and investigates their transformative potential in UAV-assisted wireless communication networks. We analyze UAV deployment strategies, network architectures, and topologies, highlighting their advantages as well as inherent challenges. Furthermore, we examine the limitations of classical RL algorithms and assess how QRL overcomes them while improving computational efficiency and exploration capabilities. In addition, we present a detailed review of existing QRL algorithms applicable to next-generation UAV-enhanced wireless networks, identifying key challenges that must be addressed for practical deployment. Finally, we identify open research challenges and offer future directions for integrating QRL into UAV-assisted communication, paving the way for scalable, intelligent, and high-performance wireless systems.
Exploring the convergence of quantum computing and machine learning, this paper delves into Quantum Reinforcement Learning (QRL) with a specific focus on Variational Quantum Circuits (VQC). Alongside a comprehensive examination of the field, the study presents a concrete implementation of QRL tailored to foundational gym environments. Leveraging principles from Quantum Computing, experiments reveal QRL’s potential in enhancing reinforcement learning tasks within these environments, showcasing notable space optimization for RL models. Quantitative results indicate a reduction in the number of trainable parameters by up to 90% when compared to classical approaches, significantly improving efficiency, mainly due to quantum principles of superposition and entanglement. This highlights the promising implications of integrating quantum computing techniques to address challenges and advance capabilities in fundamental reinforcement learning scenarios. Furthermore, the study discusses the adaptability of QRL algorithms to diverse problem domains, suggesting their potential for scalability and applicability beyond simple environments. Such versatility underscores the robustness and practical relevance of QRL methodologies in real-world scenarios, positioning them as valuable tools for tackling complex reinforcement learning challenges.