Optical Fiber Communication Conference

Deep Reinforcement Learning-based Quality-of-Service Assurance for Digital Twin-enabled Satellite Quantum Key Distribution Networks

Jingjing Liu, Xiaosong Yu, Jian Yang, Dungu Jin, Avishek Nag, Yongli Zhao, Jie Zhang

Published Jan 1, 2026• 0 citations

Abstract

Quality-of-service assurance over digital twin-enabled satellite quantum key distribution networks with deep reinforcement learning is proposed. This approach can reduce the service blocking rate by more than 70% compared to the benchmarks.

DOI: 10.1364/ofc.2026.m2k.6

Related papers

Demonstration of Hierarchical Digital Twin-enabled End-to-End Key Provisioning in SDN-based Satellite Quantum Key Distribution Networks

Jingjing Liu, Xiaosong Yu, Yongli Zhao +1 more

Hierarchical digital twin-enabled end-to-end key provisioning in satellite quantum key distribution networks is demonstrated on our testbed. The software-defined-networking control loops are enhanced with a predictive digital twin network, resulting in a reduced service blocking rate and seconds-level latency.

Asia Communications and Photonics ConferenceNov 5, 20250 citations

Quantum Deep Reinforcement Learning for Digital Twin-Enabled 6G Networks and Semantic Communications: Considerations for Adoption and Security

Bhaskara Narottama, Abrar Ul Haq, James Adu Ansere +5 more

Recently, quantum deep reinforcement learning (Q-DRL) has started to gain attention as a potential approach for tackling complex challenges in wireless communication systems. In particular, Q-DRL, integrating quantum operations into deep learning models, can effectively handle dynamic environments and process large-scale optimizations. As future wireless networks continue to evolve, greater emphasis is being placed on context and meaning rather than raw data. New paradigms, such as semantic communications (SemComs) are essential to effectively convey meaning between transmitters and receivers. By linking SemComs with Q-DRL, future wireless networks will be capable of large-scale extractions and decoding of meaning, thereby minimizing reliance on complete context sharing between communicating parties. Together with SemComs, digital twins (DTs) have been considered as key enablers for future wireless networks. As virtual replicas of physical networks, they serve an important role in network operation, optimization, and control. In this regard, Q-DRL will also be highly beneficial for DTs in enhancing critical functions such as data management and security. This study offers fresh outlooks on how to leverage Q-DRL for SemComs in future wireless networks, augmented by the use of DTs.

IEEE Transactions on Network Science and EngineeringSep 11, 202511 citations

Routing Based on Deep Reinforcement Learning in Quantum Key Distribution-secured Optical Networks

Purva Sharma, Vimal Bhatia, Shashi Prakash

Routing is a challenging problem in quantum key distribution (QKD)-secured optical networks (QKD-ONs) and involves the selection of an appropriate route that establishes a secure path between the QKD nodes for secret key distribution. Deep reinforcement learning (DRL) is a promising approach for solving decision-making problems in complex networking environments such as QKD-ONs. By leveraging the capabilities of DRL algorithms, the routing decisions can be optimized to enhance network performance. This paper proposes a DRL-based solution for routing in QKD-ONs that enables the routing agent to learn and adapt to changing network conditions by understanding the networking environment. The performance of the proposed scheme is compared with the baseline schemes on NSFNET in terms of blocking probability. Simulation results indicate that compared to the baseline schemes (shortest path (SP) and hop count (HC)), the proposed DRL-based routing scheme reduces the blocking by 14.31% and 8%, respectively.

IEEE International Conference on Advanced Networks and Telecommunications SystemsDec 17, 20234 citations

Reinforcement Learning Based Multi-Tenant Secret-Key Assignment for Quantum Key Distribution Networks

Yuan Cao, Yongli Zhao, Jun Li +3 more

We propose a reinforcement learning based online multi-tenant secret-key assignment algorithm for quantum key distribution networks, capable of reducing tenant-request blocking probability more than half compared to the benchmark heuristics.

Optical Fiber Communication ConferenceJan 1, 20199 citations

DRL-based progressive recovery for quantum-key-distribution networks

Mengyao Li, Qiaolun Zhang, Alberto Gatto +3 more

With progressive network recovery, operators restore network connectivity after massive failures along multiple stages, by identifying the optimal sequence of repair actions to maximize carried live traffic. Motivated by the initial deployments of quantum-key-distribution (QKD) over optical networks appearing in several locations worldwide, in this work we model and solve the progressive QKD network recovery (PQNR) problem in QKD networks to accelerate the recovery after failures. We formulate an integer linear programming (ILP) model to optimize the achievable accumulative key rates during recovery for four different QKD network architectures, considering different capabilities of using trusted relay and optical bypass. Due to the computational limitations of the ILP model, we propose a deep reinforcement learning (DRL) algorithm based on a twin delayed deep deterministic policy gradients (TD3) framework to solve the PQNR problem for large-scale topologies. Simulation results show that our proposed algorithm approaches well compared to the optimal solution and outperforms several baseline algorithms. Moreover, using optical bypass jointly with trusted relay can improve the performance in terms of the key rate by 14% and 18% compared to the cases where only optical bypass and only trusted relay are applied, respectively.

Journal of Optical Communications and NetworkingJul 16, 20246 citations

Quantum Enhanced Deep Reinforcement Learning for Distribution Network Reconfiguration

Daniel Germain, Mason Blanchard, Audrey Versteegen +5 more

Modern smart grids generate increasingly rich operational data and deploy greater numbers of remotely controlled switching assets than ever before, creating new opportunities for data-driven distribution network reconfiguration (DNR). DNR optimizes grid topology to improve efficiency, reduce power losses, and maintain operational constraints, but finding optimal switch configurations remains a computationally demanding combinatorial problem. In this paper, we propose a deep reinforcement learning (DRL) framework for static DNR to systematically investigate how the Q-network architecture affects both solution quality and learning performance. We evaluate multiple architectures within a controlled DRL framework, varying only the Q-network to isolate the contribution of each architectural choice. Our results show that quantum-enhanced Q-networks can achieve higher rewards with fewer parameters than their classical counterpart, suggesting that such architectures are a promising direction for combinatorial power systems optimization.

quant-pharXiv:2609.40327Oct 1, 2026