Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

International Bhurban Conference on Applied Sciences and Technology (IBCAST)

Adversarial Robust Quantum Reinforcement Learning: Defending Variational Policies Against Quantum-State Perturbations

Kainat Rizwan, Mir Wajid Ali

Published Aug 1, 2026• 0 citations
Publisher

Abstract

Quantum reinforcement learning (QRL) has shown potential significant potential for solving difficult sequence decision-making with the power of representation of quantum computing. However quantum states and their measurements are sensitive, and this implies that such systems are vulnerable to adversarial perturbation together with hardware noise. Avoiding variational quantum policy being misled by any but small, intelligible perturbations of quantum states, inputs or measurement outcomes can generate incorrect actions and unstable learning behaviour. This paper has provided an adversarially resilient quantum reinforcement learning (AR-QRL) architecture, which specifically aims to address these security and dependability challenges. It is a mixture of adversarial training, robust quantum states encoding and variance-sensitive policy optimization, which defends variational quantum policies against malicious quantumstate perturbation. Benchmarking quantum-control experiments have demonstrated improvements of 30%-40% in control fidelity to that of standard QRL, up to a 75% decreased reward variance, and a 40% acceleration of convergence under adversarial conditions.. These findings suggest the impact of adversarial robustness in improving effective and secure quantum reinforcement learning of noisy intermediate-scale quantum (NISQ) devices.

DOI
10.1109/ibcast71075.2026.11761858

Related papers

Zero-Noise Quantum Reinforcement Learning: Error-Resilient Learning Architectures for Scalable Quantum Control Systems

Kainat Rizwan

Quantum reinforcement learning (QRL) is a prospective system that can solve sequential control problems with quantum control, but the problem of hardware noise and decoherence cripples its application in noisy intermediate-scale quantum (NISQ) systems. This paper introduces a framework of Zero-Noise Quantum Reinforcement Learning (ZN-QRL), which directly includes the noise-resilient learning framework of zero-noise extrapolation (ZNE) into the policy optimization procedure. The presented architecture is implemented to perform parameterized quantum policies using amplified levels of noise and interpolates reward signal on the noise-free limit of a quantum system, where the learning agent is free to optimize policies as it would in an ideal environment with a quantum noisefree system but does not need to fully correct the error. Detailed simulation performance of quantum control benchmarks, such as state transfer and gate synthesis control, indicate that ZN-QRL is always better than standard variational QRL and post-hoc error-reducing control. In particular, the proposed framework attains control fidelity up to 30% greater, convergence is faster and more stable and performance is robust over a large dynamic depolarizing noise. Moreover, ZN-QRL also exhibits higher scalability and is able to maintain a steady learning rate with greater circuit depth and qubit count, therefore illustrating its usefulness in practical use of quantum control on existing NISQ devices.

International Conference on Information Science and Communication Technology (ICISCT)•Apr 15, 2026•0 citations

Noise-resilient quantum reinforcement learning

Jing-Ci Yue, Jun‐Hong An

As a branch of quantum machine learning, quantum reinforcement learning (QRL) aims to solve complex sequential decision-making problems more efficiently and effectively than its classical counterpart by exploiting quantum resources. However, in the noisy intermediate-scale quantum (NISQ) era, its realization is challenged by the ubiquitous noise-induced decoherence. Here, we propose a noise-resilient QRL scheme for a quantum eigensolver with a two-level system as an agent. By investigating the non-Markovian decoherence effect on the QRL for solving the eigenstates of the agent-environment interaction Hamiltonian, we find that the formation of a bound state in the energy spectrum of the total agent-noise system restores the QRL performance to that in the noiseless case. Providing a universal physical mechanism to suppress the decoherence effect on quantum machine learning, our result lays the foundation for designing NISQ algorithms and offers a guideline for their practical implementation.

arXiv:2508.20601•Physical Review Applied•Mar 26, 2026•0 citations

Adversarial Attacks and Defence Mechanisms in Quantum Machine Learning Systems

Dzulfikar Ahmed, Mohamed Hafiz, SYED ABUTHAHIR +1 more

Quantum Machine Learning (QML) is a new discipline that combines quantum computing and machine learning algorithms in order to take advantage of the computational benefits which are provided by quantum computing for performing complex problems. While similar to classical machine learning systems, quantum-models tend to be prone for adversarial attacks—craft perturbations designed purposely for causing model mispredictions. The intrinsic noise and probabilistic behavior of quantum systems— in particular the (Noisy Intermediate-Scale Quantum) NISQ—is only worsening these vulnerabilities. This paper provides an overview of adversarial threats in QML and illustrates how the quantum nature of any specific system to be attacked shapes both attack and defence strategies. We study on prevalent adversarial methods including gradient based perturbations, optimization attacks and transfer attacks among others, for their resonance in the quantum settings. And, we explore the influence of quantum noise, circuit layout, and hybrid architectures on system weaknesses. In order to develop solutions for such problems, we provide a survey of defines approaches including adversarial training noise-aware learning quantum error mitigation and robust optimization By incorporating probabilistic approaches like Bayesian inference, the ability to make decisions with uncertainty informs and strengthens resilience. Fields like cybersecurity, healthcare and autonomous systems showcase implications of adversarial robustness in QML. Lastly, the paper presents open challenges and future directions for research where some of them are on building scalable secured interpretable quantum AI systems.

International Journal of Quantum Computing and Artificial Intelligence (IJQCAI)•Jan 1, 2026•0 citations

Robustness of quantum reinforcement learning under hardware errors

Andrea Skolik, Stefano Mangini, Thomas Bäck +2 more

Abstract Variational quantum machine learning algorithms have become the focus of recent research on how to utilize near-term quantum devices for machine learning tasks. They are considered suitable for this as the circuits that are run can be tailored to the device, and a big part of the computation is delegated to the classical optimizer. It has also been hypothesized that they may be more robust to hardware noise than conventional algorithms due to their hybrid nature. However, the effect of training quantum machine learning models under the influence of hardware-induced noise has not yet been extensively studied. In this work, we address this question for a specific type of learning, namely variational reinforcement learning, by studying its performance in the presence of various noise sources: shot noise, coherent and incoherent errors. We analytically and empirically investigate how the presence of noise during training and evaluation of variational quantum reinforcement learning algorithms affect the performance of the agents and robustness of the learned policies. Furthermore, we provide a method to reduce the number of measurements required to train Q-learning agents, using the inherent structure of the algorithm.

arXiv:2212.09431•EPJ Quantum Technology•Feb 28, 2023•36 citations

Quantum Reinforcement Learning

Hamid D. Ismail

This chapter develops quantum reinforcement learning (QRL) as a principled extension of classical reinforcement learning (RL) into the quantum domain. Building on the standard Markov decision process framework, it shows how policies and value functions can be represented by quantum states and parameterized quantum circuits, with action probabilities arising from Born-rule measurement statistics and value estimates obtained from expectation values of observables. In this formulation, RL is preserved at the algorithmic level while its representational substrate is shifted from classical vector spaces to Hilbert space. The chapter emphasizes variational quantum circuits as the practical backbone of near-term QRL and analyzes how encoding strategies, entanglement structure, and measurement choices shape expressive power and trainability. It also examines quantum-enhanced exploration, showing how stochasticity emerges intrinsically from measurement rather than from externally injected noise. Policy-gradient and value-based approaches are compared, with particular attention to measurement cost, optimization stability, and near-term hardware suitability. This chapter further discusses quantum environments, sample-efficiency considerations, and hands-on implementations such as the quantum multi-armed bandit and quantum grid-world. Together, these topics establish QRL as a rigorous and practically grounded framework for studying sequential decision-making, control, and exploration in the quantum setting.

CRC Press eBooks•Nov 4, 2026•0 citations

Exploring the impact of noise on quantum DDPG in portfolio allocation

Annette Zapf, Sabine Wölk

In the era of Noisy Intermediate-Scale Quantum devices, Variational Quantum Circuits in Quantum Machine Learning are gaining attention, advancing towards practical quantum computing applications on NISQ devices. Reinforcement Learning (RL), known for its humanlike, trial-and-error learning, excels in adapting to changing financial environments. In particular, classical algorithms such as Deep Deterministic Policy Gradient (DDPG) and Proximal Policy Optimization (PPO) show promise, while emerging quantum neural networks offer potential for improved function approximation, better generalization capabilities and reduced parameters. In light of these advancements, we introduce a quantum-enhanced version of the DDPG agent (QDDPG), aiming to leverage these quantum capabilities for more efficient financial decisionmaking processes. The quantum part of the model utilizes a parameterized quantum policy, which consists of a sequential reuploading variational circuit with trainable input scaling parameters. Our objective is to explore the practicality and potential benefits of QRL in finance, aiming to realize viable quantum computing applications on NISQ devices. The QDDPG model surpasses traditional analytic strategies in portfolio allocation, achieving higher returns with fewer parameters and a favourable Sharpe ratio. In a simple configuration using a RAW-parameterized quantum policy, the model achieves an average Sharpe ratio of 1.20 across 15 trained agents, compared to 0.96 for the minimum-variance strategy and 0.81 for the buy-and-hold baseline. Furthermore we investigate the impact of quantum noise, a significant challenge for NISQ devices. We analyze various types of noise, such as general depolarization, amplitude damping, phase damping, measurement noise, and shot noise, which uniquely affect quantum computations. Our study quantifies how these noise types influence the performance, reliability, and robustness of the QRL model. We study new techniques to harness quantum noise as hyperparameter to control the exploration-exploitation balance of the agent, using noise as regularization method and to stabilize the training of the agents. This comprehensive analysis aims to not only highlight the challenges posed by quantum noise but also to explore innovative methods to mitigate these effects and enhance the applicability of quantum algorithms in real-world applications.

•Sep 10, 2024•0 citations
Quantum reinforcement learning (QRL) has shown potential significant potential for solving difficult sequence decision-making with the power of representation of quantum computing. However quantum states and their measurements are sensitive, and this implies that such systems are vulnerable to adversarial perturbation together with hardware noise. Avoiding variational quantum policy being misled by any but small, intelligible perturbations of quantum states, inputs or measurement outcomes can generate incorrect actions and unstable learning behaviour. This paper has provided an adversarially resilient quantum reinforcement learning (AR-QRL) architecture, which specifically aims to address these security and dependability challenges. It is a mixture of adversarial training, robust quantum states encoding and variance-sensitive policy optimization, which defends variational quantum policies against malicious quantumstate perturbation. Benchmarking quantum-control experiments have demonstrated improvements of 30%-40% in control fidelity to that of standard QRL, up to a 75% decreased reward variance, and a 40% acceleration of convergence under adversarial conditions.. These findings suggest the impact of adversarial robustness in improving effective and secure quantum reinforcement learning of noisy intermediate-scale quantum (NISQ) devices.
Quantum reinforcement learning (QRL) is a prospective system that can solve sequential control problems with quantum control, but the problem of hardware noise and decoherence cripples its application in noisy intermediate-scale quantum (NISQ) systems. This paper introduces a framework of Zero-Noise Quantum Reinforcement Learning (ZN-QRL), which directly includes the noise-resilient learning framework of zero-noise extrapolation (ZNE) into the policy optimization procedure. The presented architecture is implemented to perform parameterized quantum policies using amplified levels of noise and interpolates reward signal on the noise-free limit of a quantum system, where the learning agent is free to optimize policies as it would in an ideal environment with a quantum noisefree system but does not need to fully correct the error. Detailed simulation performance of quantum control benchmarks, such as state transfer and gate synthesis control, indicate that ZN-QRL is always better than standard variational QRL and post-hoc error-reducing control. In particular, the proposed framework attains control fidelity up to 30% greater, convergence is faster and more stable and performance is robust over a large dynamic depolarizing noise. Moreover, ZN-QRL also exhibits higher scalability and is able to maintain a steady learning rate with greater circuit depth and qubit count, therefore illustrating its usefulness in practical use of quantum control on existing NISQ devices.
As a branch of quantum machine learning, quantum reinforcement learning (QRL) aims to solve complex sequential decision-making problems more efficiently and effectively than its classical counterpart by exploiting quantum resources. However, in the noisy intermediate-scale quantum (NISQ) era, its realization is challenged by the ubiquitous noise-induced decoherence. Here, we propose a noise-resilient QRL scheme for a quantum eigensolver with a two-level system as an agent. By investigating the non-Markovian decoherence effect on the QRL for solving the eigenstates of the agent-environment interaction Hamiltonian, we find that the formation of a bound state in the energy spectrum of the total agent-noise system restores the QRL performance to that in the noiseless case. Providing a universal physical mechanism to suppress the decoherence effect on quantum machine learning, our result lays the foundation for designing NISQ algorithms and offers a guideline for their practical implementation.
Quantum Machine Learning (QML) is a new discipline that combines quantum computing and machine learning algorithms in order to take advantage of the computational benefits which are provided by quantum computing for performing complex problems. While similar to classical machine learning systems, quantum-models tend to be prone for adversarial attacks—craft perturbations designed purposely for causing model mispredictions. The intrinsic noise and probabilistic behavior of quantum systems— in particular the (Noisy Intermediate-Scale Quantum) NISQ—is only worsening these vulnerabilities. This paper provides an overview of adversarial threats in QML and illustrates how the quantum nature of any specific system to be attacked shapes both attack and defence strategies. We study on prevalent adversarial methods including gradient based perturbations, optimization attacks and transfer attacks among others, for their resonance in the quantum settings. And, we explore the influence of quantum noise, circuit layout, and hybrid architectures on system weaknesses. In order to develop solutions for such problems, we provide a survey of defines approaches including adversarial training noise-aware learning quantum error mitigation and robust optimization By incorporating probabilistic approaches like Bayesian inference, the ability to make decisions with uncertainty informs and strengthens resilience. Fields like cybersecurity, healthcare and autonomous systems showcase implications of adversarial robustness in QML. Lastly, the paper presents open challenges and future directions for research where some of them are on building scalable secured interpretable quantum AI systems.
Abstract Variational quantum machine learning algorithms have become the focus of recent research on how to utilize near-term quantum devices for machine learning tasks. They are considered suitable for this as the circuits that are run can be tailored to the device, and a big part of the computation is delegated to the classical optimizer. It has also been hypothesized that they may be more robust to hardware noise than conventional algorithms due to their hybrid nature. However, the effect of training quantum machine learning models under the influence of hardware-induced noise has not yet been extensively studied. In this work, we address this question for a specific type of learning, namely variational reinforcement learning, by studying its performance in the presence of various noise sources: shot noise, coherent and incoherent errors. We analytically and empirically investigate how the presence of noise during training and evaluation of variational quantum reinforcement learning algorithms affect the performance of the agents and robustness of the learned policies. Furthermore, we provide a method to reduce the number of measurements required to train Q-learning agents, using the inherent structure of the algorithm.
This chapter develops quantum reinforcement learning (QRL) as a principled extension of classical reinforcement learning (RL) into the quantum domain. Building on the standard Markov decision process framework, it shows how policies and value functions can be represented by quantum states and parameterized quantum circuits, with action probabilities arising from Born-rule measurement statistics and value estimates obtained from expectation values of observables. In this formulation, RL is preserved at the algorithmic level while its representational substrate is shifted from classical vector spaces to Hilbert space. The chapter emphasizes variational quantum circuits as the practical backbone of near-term QRL and analyzes how encoding strategies, entanglement structure, and measurement choices shape expressive power and trainability. It also examines quantum-enhanced exploration, showing how stochasticity emerges intrinsically from measurement rather than from externally injected noise. Policy-gradient and value-based approaches are compared, with particular attention to measurement cost, optimization stability, and near-term hardware suitability. This chapter further discusses quantum environments, sample-efficiency considerations, and hands-on implementations such as the quantum multi-armed bandit and quantum grid-world. Together, these topics establish QRL as a rigorous and practically grounded framework for studying sequential decision-making, control, and exploration in the quantum setting.
In the era of Noisy Intermediate-Scale Quantum devices, Variational Quantum Circuits in Quantum Machine Learning are gaining attention, advancing towards practical quantum computing applications on NISQ devices. Reinforcement Learning (RL), known for its humanlike, trial-and-error learning, excels in adapting to changing financial environments. In particular, classical algorithms such as Deep Deterministic Policy Gradient (DDPG) and Proximal Policy Optimization (PPO) show promise, while emerging quantum neural networks offer potential for improved function approximation, better generalization capabilities and reduced parameters. In light of these advancements, we introduce a quantum-enhanced version of the DDPG agent (QDDPG), aiming to leverage these quantum capabilities for more efficient financial decisionmaking processes. The quantum part of the model utilizes a parameterized quantum policy, which consists of a sequential reuploading variational circuit with trainable input scaling parameters. Our objective is to explore the practicality and potential benefits of QRL in finance, aiming to realize viable quantum computing applications on NISQ devices. The QDDPG model surpasses traditional analytic strategies in portfolio allocation, achieving higher returns with fewer parameters and a favourable Sharpe ratio. In a simple configuration using a RAW-parameterized quantum policy, the model achieves an average Sharpe ratio of 1.20 across 15 trained agents, compared to 0.96 for the minimum-variance strategy and 0.81 for the buy-and-hold baseline. Furthermore we investigate the impact of quantum noise, a significant challenge for NISQ devices. We analyze various types of noise, such as general depolarization, amplitude damping, phase damping, measurement noise, and shot noise, which uniquely affect quantum computations. Our study quantifies how these noise types influence the performance, reliability, and robustness of the QRL model. We study new techniques to harness quantum noise as hyperparameter to control the exploration-exploitation balance of the agent, using noise as regularization method and to stabilize the training of the agents. This comprehensive analysis aims to not only highlight the challenges posed by quantum noise but also to explore innovative methods to mitigate these effects and enhance the applicability of quantum algorithms in real-world applications.