Efficient utilization of key resources is one of the key problems in quantum key distribution (QKD) networks. This paper verifies the effectiveness of using reinforcement learning to realize resource allocation in QKD networks.
This paper presents a novel algorithm for optimizing the allocation of entangled resources within quantum networks. The core of the approach lies in employing a reinforcement learning (RL) framework to dynamically manage and distribute entanglement, addressing the inherent challenges of maximizing utilization and enhancing quantum communication efficiency. Unlike traditional static allocation methods, the proposed RL agent learns optimal allocation strategies through iterative interaction with a simulated quantum network environment. The algorithm considers factors such as node connectivity, qubit availability, and communication delays to minimize resource wastage and improve overall network performance. The key performance indicator (KPI) is the entanglement fidelity between communicating nodes. The developed algorithm offers a promising pathway towards realizing the full potential of quantum networks by intelligently managing their most valuable asset: entanglement. The primary goal is to achieve higher fidelity entanglement distribution and improved communication rates. The effectiveness of the algorithm is evaluated through simulations, demonstrating its ability to outperform existing allocation schemes in various network topologies and operational scenarios.
The quantum internet holds transformative potential for global communication by harnessing the principles of quantum information processing. Despite significant advancements in quantum communication technologies, the efficient distribution of critical resources, such as qubits, remains a persistent and unresolved challenge. Conventional approaches often fall short of achieving optimal resource allocation, underscoring the necessity for more effective solutions. This study proposes a novel reinforcement learning-based adaptive entanglement routing framework designed to enable resource allocation tailored to the specific demands of quantum applications. The introduced QuDQN model utilizes reinforcement learning to optimize the management of quantum networks, allocate resources efficiently, and enhance entanglement routing. The model integrates key considerations, including fidelity requirements, network topology, qubit capacity, and request demands.
This paper addresses the critical challenge of optimizing resource allocation within dynamic quantum networks (QNs). The inherent complexities of QNs, including fluctuating demands, evolving topologies, and the fragility of quantum states, necessitate adaptive resource management strategies. We propose a novel algorithm leveraging reinforcement learning (RL) to dynamically adjust resource allocation based on real-time network conditions. The algorithm learns an optimal policy by iteratively interacting with a simulated QN environment, maximizing the overall quantum channel throughput while minimizing the probability of quantum error. Specifically, the core mechanism involves formulating the resource allocation problem as a Markov Decision Process (MDP), where the state represents the network's current configuration, the action represents the allocation of quantum resources (e.g., qubits, entanglement), and the reward reflects the successful completion of quantum communication tasks. The RL agent utilizes a Q-learning algorithm to estimate the optimal Q-function, guiding the allocation process. We demonstrate, through simulation, that our algorithm significantly outperforms static allocation strategies in terms of throughput and reliability, even under highly dynamic network conditions. The key contributions of this work lie in the integration of RL with the unique characteristics of QNs and the development of a practical algorithm for adaptive resource management. Further research will explore the scalability of this approach and its application to larger, more complex QN topologies.
Abstract In quantum key distribution‐secured optical networks (QKD‐ONs), constrained network resources limit the success probability of QKD lightpath requests (QLRs). Thus, the selection of an appropriate route and the efficient utilisation of network resources for establishment of QLRs are the essential and challenging problems. This work addresses the routing and resource assignment (RRA) problem in the quantum signal channel of QKD‐ONs. The RRA problem of QKD‐ONs is a complex decision making problem, where appropriate solutions depend on understanding the networking environment. Motivated by the recent advances in deep reinforcement learning (DRL) for complex problems and also because of its capability to learn directly from experiences, DRL is exploited to solve the RRA problem and a DRL‐based RRA scheme is proposed. The proposed scheme learns the optimal policy to select an appropriate route and assigns suitable network resources for establishment of QLRs by using deep neural networks. The performance of the proposed scheme is compared with the deep‐Q network (DQN) method and two baseline schemes, namely, first‐fit (FF) and random‐fit (RF) for two different networks, namely The National Science Foundation Network (NSFNET) and UBN24. Simulation results indicate that the proposed scheme reduces blocking by 7.19%, 10.11%, and 33.50% for NSFNET and 2.47%, 3.20%, and 19.60% for UBN24 and improves resource utilisation up to 3.40%, 4.33%, and 7.18% for NSFNET and 1.34%, 1.96%, and 6.44% for UBN24 as compared with DQN, FF, and RF, respectively.
Quantum key distribution (QKD) networks are potential to be widely deployed in the immediate future to provide long-term security for data communications. Given the high price and complexity, multi-tenancy has become a cost-effective pattern for QKD network operations. In this work, we concentrate on addressing the online multi-tenant provisioning (On-MTP) problem for QKD networks, where multiple tenant requests (TRs) arrive dynamically. On-MTP involves scheduling multiple TRs and assigning non-reusable secret keys derived from a QKD network to multiple TRs, where each TR can be regarded as a high-security-demand organization with the dedicated secret-key demand. The quantum key pools (QKPs) are constructed over QKD network infrastructure to improve management efficiency for secret keys. We model the secret-key resources for QKPs and the secret-key demands of TRs using distinct images. To realize efficient On-MTP, we perform a comparative study of heuristics and reinforcement learning (RL) based On-MTP solutions, where three heuristics (i.e., random, fit, and best-fit based On-MTP algorithms) are presented and a RL framework is introduced to realize automatic training of an On-MTP algorithm. The comparative results indicate that with sufficient training iterations the RL-based On-MTP algorithm significantly outperforms the presented heuristics in terms of tenant-request blocking probability and secret-key resource utilization.
Quantum Key Distribution (QKD) has the main advantage of providing unconditional security, which is a consequence of the fundamental principles of quantum mechanics. For decades, key quantum distribution system has been the technological heart of security systems. However, the existing real QKD approaches have performance limitations. The channel experiences interference, photon loss, and fluctuations in eavesdropping conditions that reduce the efficiency and reliability of key generation. To address these issues, a fuzzy reinforcement learning-enhanced quantum key distribution (FRL-QKD) system is proposed to obtain secure and adaptable quantum communications. The integrated network combines fuzzy logic with reinforcement learning (RL) to expedite the localization of the photon polarization basis selection, control of key rates, and identification of error correction thresholds for optimized key generation. Fuzzy inference mechanisms are utilized within the FRL-QKD model to interpret an ambiguous environment. This first-stage implementation of the symbiosis of quantum cryptography, fuzzy intelligence and adaptive learning is a potent resource for future quantum-secure communications.