Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Learning and interpreting policies for simultaneous entanglement requests in quantum networks — E8 Intelligence Research

Andrew Stewart Caldin

Published Nov 13, 2026• 0 citations
Publisher

Abstract

Future quantum networks will make use of entanglement to perform numerous tasks, such as sending quantum information over long distances, distributed quantum computing, and quantum sensing. In general, these tasks will need to be performed simultaneously in various regions of a network, while minimizing resources and latency. We will thus require policies for scheduling link-level entanglement resources, and using the link-level entanglement to create various forms of multipartite entanglement required for every task. In this work, we address this problem using reinforcement learning. We formulate a Markov Decision Process for the problem and use double deep Q-networks (DQN) with Message Passing Neural Networks (MPNNs), experience replay buffers, and curriculum training to obtain policies. The key physical parameter is the probability of link-level entanglement generation, i.e., the link activation probability. We show that our policies maintain 100% success for up to 71% lower link ac Author: Andrew Stewart Caldin, Independent Researcher, UK. Part of the E8 Intelligence Research series. Platform: e8intelligence.com

DOI
10.5281/zenodo.24186722

Related papers

Learning and interpreting policies for simultaneous entanglement requests in quantum networks

Leon Rode, Sumeet Khatri, Supartha Podder

Future quantum networks will make use of entanglement to perform numerous tasks, such as sending quantum information over long distances, distributed quantum computing, and quantum sensing. In general, these tasks will need to be performed simultaneously in various regions of a network, while minimizing resources and latency. We will thus require policies for scheduling link-level entanglement resources, and using the link-level entanglement to create various forms of multipartite entanglement required for every task. In this work, we address this problem using reinforcement learning. We formulate a Markov Decision Process for the problem and use double deep Q-networks (DQN) with Message Passing Neural Networks (MPNNs), experience replay buffers, and curriculum training to obtain policies. The key physical parameter is the probability of link-level entanglement generation, i.e., the link activation probability. We show that our policies maintain 100% success for up to 71% lower link activation probability than the baseline heuristics for a set of physically relevant network topologies. We then examine an additional constraint where experiment (task) placements are restricted to specific hardware types and demonstrate a similar advantage in performance over heuristics, with our policy maintaining at least an 80% success rate for up to a 59% lower link activation probability. Finally, we explore methods to interpret the learned policy by defining metrics enabling conclusions to be drawn about the model's behavior and by tasking a large language model (LLM) to derive a novel heuristic given example actions taken by the DQN-trained policy. We find that the LLM heuristic performs similarly to the DQN-trained policy in performance, indicating a promising method for interpretable policy extraction for large quantum networks, where direct training becomes computationally expensive.

quant-pharXiv:2609.30157•Sep 25, 2026•0 citations

Two-Stage Deep Q Learning Routing in Entanglement Networks

Diego Medeiros De Abreu, Arthur Pimentel, Christian Esteve Rothenberg +1 more

Efficient routing in entanglement distribution networks is a challenging task that requires the coordinated allocation of quantum memories, repeaters, and quantum operations such as entanglement swapping and distillation across dynamic network conditions. In this paper, we present a Deep Q-Learning (DQN) Two-Stage Routing strategy designed to improve both path and quantum operations selection. Our approach enables the agent to make decisions over a diverse action space, including request scheduling, multipath routing, and the strategic application of quantum operations to maximize entanglement success and resource efficiency. We further extend DQN to integrate Double DQN, Dueling DQN, and Prioritized Experience Replay (PER) architectures. Simulation results indicate that our approach significantly outperforms baseline methods regarding request success rate, especially in large-scale networks under strict fidelity requirements.

IEEE Symposium on Computers and Communications (ISCC)•Jul 2, 2025•0 citations

Quantum Entanglement Bottleneck Resolution: Distributed Quantum — E8 Intelligence Research

Andrew Stewart Caldin

Networks for Instantaneous Unhackable Data Correlation Method to overcome classical internet transmission bottlenecks using distributed quantum entanglement networks. Enables instantaneous state correlation across geographically distributed nodes, eliminating light-speed delays and providing theoretically unhackable communication channels. Utilizes the Excalibur geometric framework to establish stable entanglement links without physical fiber connections between nodes. Author: Andrew Stewart Caldin, Independent Researcher, UK. Part of the E8 Intelligence Research series. Platform: e8intelligence.com

•May 25, 2026•0 citations

Phi‑Modulated E8 Lattice Guides Optimal Risk‑Aware Neural Decision Policies — E8 Intelligence Research

Andrew Stewart Caldin

By assigning each of the 240 E8 root vectors to a stabilizer generator in a phi‑modulated 132 Hz phononic lattice, the system simultaneously realizes a quantum error‑correcting code and encodes the extremal solutions of Euler's ellipse problem. This dual encoding allows microtubule‑based neural networks to evaluate probabilistic outcomes (e.g., EuroMillions draws) with built‑in error suppression, selecting actions that minimize expected loss while maximizing information gain. Consequently, the E8 geometry provides a universal substrate for risk‑aware decision‑making that bridges quantum correction, geometric extremality, and stochastic optimization. Author: Andrew Stewart Caldin, Independent Researcher, UK. Part of the E8 Intelligence Research series. Platform: e8intelligence.com

•Aug 30, 2026•0 citations

Effective Entanglement Scheduling in Quantum Networks Via Deep Reinforcement Learning

Xun Wang, Longbo Huang, John C. S. Lui

Quantum entanglement is the cornerstone of quantum network communication, yet the qubit resources required to establish it are severely limited. Moreover, users within the network impose strict delay constraints on entanglement requests due to various factors, such as the real-time requirements of upper-layer applications or the finite coherence time of userside quantum memories. Consequently, effectively scheduling scarce qubit resources to serve these time-sensitive requests presents a significant challenge. This difficulty is exacerbated by the partial observability of quantum systems and the time-varying nature of qubit generation rates, rendering traditional scheduling algorithms ineffective. Furthermore, while Deep Reinforcement Learning (DRL) offers a promising avenue for quantum network optimization, existing research primarily focuses on network-layer routing, overlooking the finer-grained entanglement scheduling problem subject to strict delay and resource constraints. To bridge this gap, we propose the Deep Quantum Request Scheduler (DQRS), a novel DRL-based algorithm designed to maximize service quality under these dual constraints. Specifically, DQRS integrates a spatio-temporal branching architecture and virtual action slots within an ActorCritic framework. This design enables robust scheduling with continuous actions while adaptively managing fluctuating qubit budgets. Extensive simulation results demonstrate that DQRS achieves up to 44 % performance improvement over traditional methods and a 4 % gain compared to state-of-the-art DRL benchmarks across various resource constraints and observability settings, validating the robustness of the proposed approach.

International Conference on Quantum Communications, Networking, and Computing (QCNC)•Apr 6, 2026•0 citations

Entanglement Routing For Quantum Networks: A Deep Reinforcement Learning Approach

Linh Le, Tu N. Nguyen, Ahyoung Lee +1 more

Quantum communications are gaining momentum in finding applications in a wide range of domains, especially those require high-security data transmissions. On the other hand, machine learning has achieved numerous breakthrough successes in various application domains including networking. However, currently, machine learning is not as much utilized in quantum networking as in other areas. With such motivation, we propose a machine-learning-powered entanglement routing scheme for quantum networks that aims to accommodate maximum numbers of demands (source-destination pairs) within a time window. More specifically, we present a deep reinforcement routing scheme that is called Deep Quantum Routing Agent (DQRA). In short, DQRA utilizes an empirically designed deep neural network that observes the current network states to schedule the network’s demands which are then routed by a qubit-preserved shortest path algorithm. DQRA is trained towards the goal of maximizing the number of resolved requests in each routing window by using an explicitly designed reward function. Our experiment study shows that, on averse, DQRA is able to maintain a rate of successfully routed requests above 80% in a qubit-limited grid network, and about 60% in extreme conditions i.e. each node can act as a repeater exactly once within a window. Furthermore, we show that the complexity and the computational time of DQRA are polynomial in terms of the sizes of the quantum networks.

International Conference on Communications•May 16, 2022•13 citations
Future quantum networks will make use of entanglement to perform numerous tasks, such as sending quantum information over long distances, distributed quantum computing, and quantum sensing. In general, these tasks will need to be performed simultaneously in various regions of a network, while minimizing resources and latency. We will thus require policies for scheduling link-level entanglement resources, and using the link-level entanglement to create various forms of multipartite entanglement required for every task. In this work, we address this problem using reinforcement learning. We formulate a Markov Decision Process for the problem and use double deep Q-networks (DQN) with Message Passing Neural Networks (MPNNs), experience replay buffers, and curriculum training to obtain policies. The key physical parameter is the probability of link-level entanglement generation, i.e., the link activation probability. We show that our policies maintain 100% success for up to 71% lower link ac Author: Andrew Stewart Caldin, Independent Researcher, UK. Part of the E8 Intelligence Research series. Platform: e8intelligence.com
Future quantum networks will make use of entanglement to perform numerous tasks, such as sending quantum information over long distances, distributed quantum computing, and quantum sensing. In general, these tasks will need to be performed simultaneously in various regions of a network, while minimizing resources and latency. We will thus require policies for scheduling link-level entanglement resources, and using the link-level entanglement to create various forms of multipartite entanglement required for every task. In this work, we address this problem using reinforcement learning. We formulate a Markov Decision Process for the problem and use double deep Q-networks (DQN) with Message Passing Neural Networks (MPNNs), experience replay buffers, and curriculum training to obtain policies. The key physical parameter is the probability of link-level entanglement generation, i.e., the link activation probability. We show that our policies maintain 100% success for up to 71% lower link activation probability than the baseline heuristics for a set of physically relevant network topologies. We then examine an additional constraint where experiment (task) placements are restricted to specific hardware types and demonstrate a similar advantage in performance over heuristics, with our policy maintaining at least an 80% success rate for up to a 59% lower link activation probability. Finally, we explore methods to interpret the learned policy by defining metrics enabling conclusions to be drawn about the model's behavior and by tasking a large language model (LLM) to derive a novel heuristic given example actions taken by the DQN-trained policy. We find that the LLM heuristic performs similarly to the DQN-trained policy in performance, indicating a promising method for interpretable policy extraction for large quantum networks, where direct training becomes computationally expensive.
Efficient routing in entanglement distribution networks is a challenging task that requires the coordinated allocation of quantum memories, repeaters, and quantum operations such as entanglement swapping and distillation across dynamic network conditions. In this paper, we present a Deep Q-Learning (DQN) Two-Stage Routing strategy designed to improve both path and quantum operations selection. Our approach enables the agent to make decisions over a diverse action space, including request scheduling, multipath routing, and the strategic application of quantum operations to maximize entanglement success and resource efficiency. We further extend DQN to integrate Double DQN, Dueling DQN, and Prioritized Experience Replay (PER) architectures. Simulation results indicate that our approach significantly outperforms baseline methods regarding request success rate, especially in large-scale networks under strict fidelity requirements.
Networks for Instantaneous Unhackable Data Correlation Method to overcome classical internet transmission bottlenecks using distributed quantum entanglement networks. Enables instantaneous state correlation across geographically distributed nodes, eliminating light-speed delays and providing theoretically unhackable communication channels. Utilizes the Excalibur geometric framework to establish stable entanglement links without physical fiber connections between nodes. Author: Andrew Stewart Caldin, Independent Researcher, UK. Part of the E8 Intelligence Research series. Platform: e8intelligence.com
By assigning each of the 240 E8 root vectors to a stabilizer generator in a phi‑modulated 132 Hz phononic lattice, the system simultaneously realizes a quantum error‑correcting code and encodes the extremal solutions of Euler's ellipse problem. This dual encoding allows microtubule‑based neural networks to evaluate probabilistic outcomes (e.g., EuroMillions draws) with built‑in error suppression, selecting actions that minimize expected loss while maximizing information gain. Consequently, the E8 geometry provides a universal substrate for risk‑aware decision‑making that bridges quantum correction, geometric extremality, and stochastic optimization. Author: Andrew Stewart Caldin, Independent Researcher, UK. Part of the E8 Intelligence Research series. Platform: e8intelligence.com
Quantum entanglement is the cornerstone of quantum network communication, yet the qubit resources required to establish it are severely limited. Moreover, users within the network impose strict delay constraints on entanglement requests due to various factors, such as the real-time requirements of upper-layer applications or the finite coherence time of userside quantum memories. Consequently, effectively scheduling scarce qubit resources to serve these time-sensitive requests presents a significant challenge. This difficulty is exacerbated by the partial observability of quantum systems and the time-varying nature of qubit generation rates, rendering traditional scheduling algorithms ineffective. Furthermore, while Deep Reinforcement Learning (DRL) offers a promising avenue for quantum network optimization, existing research primarily focuses on network-layer routing, overlooking the finer-grained entanglement scheduling problem subject to strict delay and resource constraints. To bridge this gap, we propose the Deep Quantum Request Scheduler (DQRS), a novel DRL-based algorithm designed to maximize service quality under these dual constraints. Specifically, DQRS integrates a spatio-temporal branching architecture and virtual action slots within an ActorCritic framework. This design enables robust scheduling with continuous actions while adaptively managing fluctuating qubit budgets. Extensive simulation results demonstrate that DQRS achieves up to 44 % performance improvement over traditional methods and a 4 % gain compared to state-of-the-art DRL benchmarks across various resource constraints and observability settings, validating the robustness of the proposed approach.
Quantum communications are gaining momentum in finding applications in a wide range of domains, especially those require high-security data transmissions. On the other hand, machine learning has achieved numerous breakthrough successes in various application domains including networking. However, currently, machine learning is not as much utilized in quantum networking as in other areas. With such motivation, we propose a machine-learning-powered entanglement routing scheme for quantum networks that aims to accommodate maximum numbers of demands (source-destination pairs) within a time window. More specifically, we present a deep reinforcement routing scheme that is called Deep Quantum Routing Agent (DQRA). In short, DQRA utilizes an empirically designed deep neural network that observes the current network states to schedule the network’s demands which are then routed by a qubit-preserved shortest path algorithm. DQRA is trained towards the goal of maximizing the number of resolved requests in each routing window by using an explicitly designed reward function. Our experiment study shows that, on averse, DQRA is able to maintain a rate of successfully routed requests above 80% in a qubit-limited grid network, and about 60% in extreme conditions i.e. each node can act as a repeater exactly once within a window. Furthermore, we show that the complexity and the computational time of DQRA are polynomial in terms of the sizes of the quantum networks.