Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
Quantum Contextual Bandits: Integrating Bandit Exploration into Quantum Neural Network
Tianyi Chen, Shiva Raj Pokhrel, Jiang Fang, Yinlong Liu, Jiyan Sun, Liru Geng, Gang Li
Abstract
Supervised quantum learning methods face notable limitations in dynamic, real-world environments due to their reliance on static labels and limited adaptability. To address these challenges, we propose a novel online learning framework-Quantum Contextual Bandit (QCB)-that integrates quantum neural networks (QNNs) with contextual bandit (CB) algorithms. The QCB framework enables adaptive decision-making by incorporating bandit-based exploration into QNN training, making it particularly suitable for applications such as recommender systems and resource allocation in next-generation 5G/6G networks. To mitigate the adverse effects of quantum noise-including depolarizing, Pauli, and shot noise, the framework leverages a gradient-free optimization approach, enhancing robustness and convergence stability. Experimental results on various datasets demonstrate that QCB consistently outperforms traditional QNN training methods with identical circuit architectures. Notably, the model achieves over 99 % accuracy under ideal conditions and sustains high performance under noisy quantum environments. These results underscore the potential of QCB as a scalable, noise-resilient solution for adaptive learning in quantum machine learning systems.