Modern smart grids generate increasingly rich operational data and deploy greater numbers of remotely controlled switching assets than ever before, creating new opportunities for data-driven distribution network reconfiguration (DNR). DNR optimizes grid topology to improve efficiency, reduce power losses, and maintain operational constraints, but finding optimal switch configurations remains a computationally demanding combinatorial problem. In this paper, we propose a deep reinforcement learning (DRL) framework for static DNR to systematically investigate how the Q-network architecture affects both solution quality and learning performance. We evaluate multiple architectures within a controlled DRL framework, varying only the Q-network to isolate the contribution of each architectural choice. Our results show that quantum-enhanced Q-networks can achieve higher rewards with fewer parameters than their classical counterpart, suggesting that such architectures are a promising direction for combinatorial power systems optimization.
Modern smart grids generate increasingly rich operational data and deploy greater numbers of remotely controlled switching assets than ever before, creating new opportunities for data-driven distribution network reconfiguration (DNR). DNR optimizes grid topology to improve efficiency, reduce power losses, and maintain operational constraints, but finding optimal switch configurations remains a computationally demanding combinatorial problem. In this paper, we propose a deep reinforcement learning (DRL) framework for static DNR to systematically investigate how the Q-network architecture affects both solution quality and learning performance. We evaluate multiple architectures within a controlled DRL framework, varying only the Q-network to isolate the contribution of each architectural choice. Our results show that quantum-enhanced Q-networks can achieve higher rewards with fewer parameters than their classical counterpart, suggesting that such architectures are a promising direction for combinatorial power systems optimization.
Volt-VAR control (VVC) is crucial in active distribution networks for optimizing voltage profiles and minimizing network losses. While traditional deep reinforcement learning (DRL) algorithms exhibit promise for VVC, they often require extensive computational resources to handle such a high-dimensional problem. As a potential solution, quantum reinforcement learning (QRL) algorithms integrate the computational capabilities of quantum computing into the DRL framework. However, existing QRL algorithms struggle with complex VVC problems due to the limitations of current quantum hardware. To bridge this gap, this paper proposes an innovative QRL algorithm featuring an end-to-end architecture that integrates a classical autoencoder, variational quantum circuits (VQCs), and classical post-processing layers. This design efficiently compresses high-dimensional grid states, enabling VQCs to leverage quantum advantages while producing multiple control device outputs, specifically tailored for VVC tasks. Numerical studies on three representative distribution systems verify the effectiveness and scalability of the proposed QRL algorithm, and demonstrate its enhanced performance over classical approaches with only approximately 1% of the parameters. Additionally, the robustness of our developed algorithm is validated through noisy quantum environments.
The significant rise in wireless communication, driven by sixth-generation (6G) networks, underscores the urgent need for innovative resource allocation methods to achieve efficiency, scalability, and reliability. This survey explores the integration of Quantum Deep Reinforcement Learning (QDRL) as a strategy to address the challenges posed by dynamic and complex wireless environments. By leveraging quantum computing features such as superposition and entanglement, QDRL enhances computational efficiency and mitigates the scalability limitations of classical and deep reinforcement learning (DRL) in high-dimensional optimization. The study reviews recent QDRL approaches for key resource allocation tasks, including power distribution, user scheduling, and channel assignment, and examines quantum algorithms such as the Quantum Approximate Optimization Algorithm (QAOA) and Quantum Neural Networks (QNN) for improved decision-making in wireless systems. Furthermore, it emphasizes the connection between quantum computing and DRL, highlighting hybrid architectures that balance computational cost, energy efficiency, and scalability. Finally, the survey identifies research gaps and outlines future directions, paving the way for robust QDRL strategies to support next-generation wireless networks.
The integration of Quantum-Inspired Reinforcement Learning (QiRL) into Edge-Driven CyberPhysical Systems (CPS) presents a transformative approach to enhance real-time decision-making in distributed environments. While classical reinforcement learning (RL) struggles with scalability and computational complexity in edge-CPS, quantum-inspired Quantum-Inspired Reinforcement Learning for Edge-Driven Cyber-Physical Systems algorithms leverage superposition and entanglement principles to optimize policy exploration and convergence. This paper proposes a novel QiRL framework that combines quantum-inspired optimization with deep RL, enabling efficient resource allocation and adaptive control in latency-sensitive applications (e.g., smart grids, autonomous drones). We formalize the mathematical foundations of QiRL, design a hybrid neural-quantum architecture for edge deployment, and evaluate its performance under dynamic CPS constraints. Simulations on IoT-based case studies demonstrate 20−35% faster convergence and 15% higher energy efficiency compared to classical Deep Q-Networks (DQN). Key challenges, such as quantum noise simulation and edge-hardware limitations, are discussed to guide future research. This work bridges quantum computing principles with edge intelligence, offering a scalable pathway for nextgeneration CPS.
Quantum networks attract increasing attention due to their unique advantages over classical networks. However, the challenge of efficiently and economically constructing reliable wide-area quantum networks remains unresolved. This problem, termed network planning, is typically modeled as an Integer Linear Programming (ILP) problem. Existing solver-based solutions for classical networks face scalability issues, while heuristic approaches that sacrifice optimality for scalability heavily rely on human expertise and lack generalizability. Recently, deep reinforcement learning (DRL) has demonstrated potential in adaptive decision-making for classical network planning. However, quantum networks introduce unique constraints due to their end-to-end entanglement distribution requirements. To address this, we propose a two-stage quantum network resource allocation framework, QPLAN, that combines multi-agent DRL with traditional optimization solvers. Our approach uses a novel multi-agent reinforcement learning strategy using graph neural networks (GNNs) and transformers for traffic flow and corresponding hardware resource allocation to minimize hardware cost while cooperatively satisfying problem constraints as much as possible. The output of the DRL algorithm is then used as an initial input to prune the solution space, "warm-starting" the ILP solver and further improving the solution. This hybrid approach effectively reduces manual effort and enhances scalability. Experimental results show that our method yields near-optimal solutions with better scalability than only using ILP solvers.
The rapid expansion of large-scale data analytics (LSDA) has presented significant issues concerning computing efficiency, scalability, adaptive learning, and model interpretability. In recent years, quantum-inspired deep reinforcement learning (QIDRL) has emerged as a promising research paradigm that integrates quantum-inspired optimization (QIO) concepts with deep reinforcement learning (DRL) approaches to enhance intelligent decision-making and complicated data processing. The need for transparent and reliable artificial intelligence (AI) systems has heightened the significance of interpretable learning frameworks that can elucidate model behavior and prediction results. This work offers a thorough examination of interpretable QIDRL methods for extensive data analysis. The review methodically examines current advancements in QIO models, interpretable RL architectures, policy explanation mechanisms, and scalable deep learning (DL) frameworks used for high-dimensional and dynamic datasets. The report examines the use of these methodologies across many sectors, including healthcare analytics, cybersecurity, smart transportation, industrial automation, financial forecasting, and intelligent Internet of Things (IoT) ecosystems. The study examines the benefits of QIDRL techniques in improving convergence speed, adaptive decision-making, feature optimization, and interpretability inside extensive analytical systems. Furthermore, significant research obstacles like computational complexity, training instability, scalability limitations, insufficient benchmark datasets, and the absence of defined criteria for interpretability assessment are thoroughly examined. The study emphasizes new research trends and prospects for creating robust, efficient, and transparent QIDRL frameworks for advanced intelligent DA applications.
Abstract: Quantum deep reinforcement learning is an integration of the principles of quantum computing with deep reinforcement learning in an effort to advance robot navigation tasks. Due to the explosion of the state and action spaces, traditionally DRL methods are limited in scalability and efficiency. QDRL, however, uses quantum superposition and entanglement for more efficient processing of big amounts of information-it enables robots to learn optimal policies for navigating complex environments. We introduce here a new QDRL framework in which quantum neural networks encode policy functions and value estimates. We demonstrate how quantum circuits can take advantage of multi-dimensional state representations in order to strengthen the power of a robot in changing its environment over time. Benchmark experiments on navigation tasks reflect phenomenal acceleration in learning performance along with better decision-making accuracy compared to classical DRL methods. We then consider integrating such quantum algorithms, as Grover's search, to improve exploration strategies in sparse reward settings. The experiments show that QDRL speeds up convergence rates and provides robots with the possibility to react more rapidly to unexpected obstacles. It discusses new applications for quantum computing of autonomous systems, potentially applied to robotics, autonomous vehicles, and other environments which require complex decision making. Some lines of work in the future are optimization of the resources needed for quantum computers and hybrid architectures for the resolution of classical problems in navigation