Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

IEEE International Conference on VLSI Systems, Architecture, Technology and Applications (VLSI SATA)

Quantum-Enhanced Deep Q Learning with Parametrized Quantum Circuit

T D Manjunath, Biswajit R. Bhowmik

Published May 17, 2024• 9 citations
Publisher

Abstract

Quantum Computing (QC) is fastly growing to replace current computing systems for many high-performance applications. Due to the rapid increase of computational power, machine learning models based on artificial neural networks (ANN) have become highly effective. Even though classical machine learning models have been performing well, quantum computing with machine learning, i.e., Quantum Machine Learning (QML), will enhance the performance in multiple ways. Subsequently, Deep$Q$learning is a prominent approach to reinforcement learning used in solving complex applications for a desired performance. But this performance can be improved using a quantum computer. This paper proposes a quantum-enhanced Deep Q Learning algorithm to see its advantages over its classical counterparts. We implement our approach using parametrized quantum circuit (PQC). The evaluation of the proposed method achieves the metrics rewards and episodes up to 500 points and 1200, respectively. The performance shows that it collects roughly four times more rewards in a given time and takes significantly fewer episodes to converge compared to the classical approach.

DOI
10.1109/vlsisata61709.2024.10560314

Related papers

Parametrized Quantum Circuits for Reinforcement Learning

Kelvin Tafadzwa Mpofu, Patience T. Mthunzi-Kufa

Research on quantum computing is still in its infancy, but it has a lot of potential uses. One topic with potential is machine learning, namely in the field of reinforcement learning. This work examines the integration of parametrized quantum circuits (PQC) into reinforcement learning (RL) algorithms, assessing the potential of quantum-enhanced models to solve classical RL tasks. It closely follows the example found on the TensorFlow website. This paper reviews applications of quantum reinforcement learning (QRL). We examine PQCs in a standard RL scenario, the CartPole-v1 environment from Gym, using TensorFlow Quantum and Cirq, to evaluate the relative performance of quantum versus conventional models. In comparison to conventional deep neural network (ONN) models, PQCs show slower convergence and higher processing needs, even if they are still able to learn the task and perform competitively. After they are fully trained, the quantum models show unique difficulties during the early training stages and reach a performance stability level like classical methods. This study sheds light on the present constraints as well as possible uses of quantum computing in reinforcement learning, particularly in situations with intricate, high-dimensional settings that prove difficult for classical computers to handle effectively. As we look to the future, we suggest that investigating hybrid quantum-classical algorithms, developing quantum hardware, and using quantum RL for increasingly difficult tasks are essential first steps. The study presents findings from both a classical reinforcement learning algorithm and a quantum integrated reinforcement learning algorithm. To provide a reliable comparison between quantum reinforcement algorithms and their classical equivalents, further work remains. This work lays the groundwork for future advances in the field by investigating the viability and use of quantum algorithms in reinforcement learning, even if it is not particularly unique. The purpose of this work is to help newcomers to this emerging field of study.

International Multidisciplinary Information Technology and Engineering Conference (IMITEC)•Nov 27, 2024•5 citations

Reinforcement Learning with Deep Quantum Neural Networks

Wei Hu, James Lee Hu

The advantage of quantum computers over classical computers fuels the recent trend of developing machine learning algorithms on quantum computers, which can potentially lead to breakthroughs and new learning models in this area. The aim of our study is to explore deep quantum reinforcement learning (RL) on photonic quantum computers, which can process information stored in the quantum states of light. These quantum computers can naturally represent continuous variables, making them an ideal platform to create quantum versions of neural networks. Using quantum photonic circuits, we implement Q learning and actor-critic algorithms with multilayer quantum neural networks and test them in the grid world environment. Our experiments show that 1) these quantum algorithms can solve the RL problem and 2) compared to one layer, using three layer quantum networks improves the learning of both algorithms in terms of rewards collected. In summary, our findings suggest that having more layers in deep quantum RL can enhance the learning outcome.

Journal of Quantum Information Science•Jan 1, 2019•13 citations

Implementation of Quantum Deep Reinforcement Learning Using Variational Quantum Circuits

S Lokes, C. Sakthi Jay Mahenthar, S Parvatha Kumaran +2 more

With the evolution of technology, the need to solve complex computational problems like machine learning and deep learning has shot up. However, even the most powerful classical supercomputers find it difficult to execute these tasks. Advancements in quantum computing are leading researchers and tech-giants who strive for better quantum circuits to do machine learning tasks. Current works on Quantum Machine Learning (QML) ensure less memory consumption and reduced model parameters. However, it is strenuous to simulate the classical deep learning approach on existing quantum computing devices due to the inflexibility of Deep quantum circuits. Consequently, designing viable quantum algorithms for QML for noisy intermediate-scale quantum (NISQ) devices is essential. The proposed work aims to explore Variational Quantum Circuits (VQC) for Deep Q network-based Reinforcement Learning by remodeling the target network and experience replay into a representation of VQC. In addition, to the reduction in model parameters, quantum information encoding schemes are used to achieve better results than classical neural networks. VQCs are employed for policyselection and decision-making reinforcement learning by approximating the deep Q-value function with target network and experience replay.

International Conference on Trends in Quantum Computing and Emerging Business Technologies (TQCEBT)•Oct 13, 2022•19 citations

Quantum Machine Learning and Recent Advancements

T D Manjunath, Biswajit R. Bhowmik

Quantum Computing is a fastly growing area with many applications, including quantum machine learning (QML). Due to the rapid increase of computational power, machine learning models based on artificial neural networks (ANN) have become highly effective. Even though classical machine learning models have been performing well, quantum computing with machine learning enhances the performance in multiple ways. This paper studies different aspects of quantum machine learning. It introduces quantum computing over classical computation, followed by the recent tools and techniques developed in the area. We look at multiple QML models like quantum kernel, quantum support vector machine (QSVM), etc. Finally, we present the literature survey to encourage researchers and academicians.

International Conference on Artificial Intelligence and Smart Communication (AISC)•Jan 27, 2023•11 citations

Quantum Circuit-Based Learning Models: Bridging Quantum Computing and Machine Learning

Fan Fan, Yilei Shi, Mihai Datcu +5 more

Machine Learning (ML) has been widely applied across numerous domains due to its ability to automatically identify informative patterns from data for various tasks. The availability of large-scale data and advanced computational power enables the development of sophisticated models and training strategies, leading to state-of-the-art performance, but it also introduces substantial challenges. Quantum Computing (QC), which exploits quantum mechanisms for computation, has attracted growing attention and significant global investment as it may address these challenges. Consequently, Quantum Machine Learning (QML), the integration of these two fields, has received increasing interest, with a notable rise in related studies in recent years. We are motivated to review these existing contributions regarding quantum circuit-based learning models for classical data analysis and highlight the identified potentials and challenges of this technique. Specifically, we focus not only on QML models, both kernel-based and neural network-based, but also on recent explorations of their integration with classical machine learning layers within hybrid frameworks. Moreover, we examine both theoretical analysis and empirical findings to better understand their capabilities, and we also discuss the efforts on noise-resilient and hardware-efficient QML that could enhance its practicality under current hardware limitations. In addition, we cover several emerging paradigms for advanced quantum circuit design and highlight the adaptability of QML across representative application domains. This study aims to provide an overview of the contributions made to bridge quantum computing and machine learning, offering insights and guidance to support its future development and pave the way for broader adoption in the coming years.

quant-pharXiv:2602.00048•Artificial Intelligence Review•Jan 20, 2026•0 citations

Quantum Machine Learning: Exploring Quantum Algorithms for Enhancing Deep Learning Models

Hari Gonaygunta, Mohan Harish Maturi, Geeta Sandeep Nadella +2 more

Using quantum algorithms to improve deep learning models' capabilities is becoming increasingly popular as quantum computing develops. In this work, we investigate how quantum algorithms using quantum neural networks (QNNs) might enhance the effectiveness and performance of deep learning models. We examine the effects of quantum-inspired methods on tasks, including regression, sorting, and optimization, by thoroughly analyzing quantum algorithms and how they integrate with deep learning systems. We experiment with Estimator QNN and Sampler QNN implementations using Qiskit machine-learning, analyzing their forward and backward pass outcomes to assess the effectiveness of quantum algorithms in improving deep learning models. Our research clarifies the scope, intricacy, and scalability issues surrounding QNNs and offers insights into the possible advantages and difficulties of quantum-enhanced deep learning. This work adds to the continuing investigation of quantum computing's potential to advance machine learning and artificial intelligence paradigms by clarifying the interaction between quantum algorithms and deep learning systems.

International Journal of Advanced Engineering Research and Science•Jan 1, 2024•20 citations
Quantum Computing (QC) is fastly growing to replace current computing systems for many high-performance applications. Due to the rapid increase of computational power, machine learning models based on artificial neural networks (ANN) have become highly effective. Even though classical machine learning models have been performing well, quantum computing with machine learning, i.e., Quantum Machine Learning (QML), will enhance the performance in multiple ways. Subsequently, DeepQQQlearning is a prominent approach to reinforcement learning used in solving complex applications for a desired performance. But this performance can be improved using a quantum computer. This paper proposes a quantum-enhanced Deep Q Learning algorithm to see its advantages over its classical counterparts. We implement our approach using parametrized quantum circuit (PQC). The evaluation of the proposed method achieves the metrics rewards and episodes up to 500 points and 1200, respectively. The performance shows that it collects roughly four times more rewards in a given time and takes significantly fewer episodes to converge compared to the classical approach.
Research on quantum computing is still in its infancy, but it has a lot of potential uses. One topic with potential is machine learning, namely in the field of reinforcement learning. This work examines the integration of parametrized quantum circuits (PQC) into reinforcement learning (RL) algorithms, assessing the potential of quantum-enhanced models to solve classical RL tasks. It closely follows the example found on the TensorFlow website. This paper reviews applications of quantum reinforcement learning (QRL). We examine PQCs in a standard RL scenario, the CartPole-v1 environment from Gym, using TensorFlow Quantum and Cirq, to evaluate the relative performance of quantum versus conventional models. In comparison to conventional deep neural network (ONN) models, PQCs show slower convergence and higher processing needs, even if they are still able to learn the task and perform competitively. After they are fully trained, the quantum models show unique difficulties during the early training stages and reach a performance stability level like classical methods. This study sheds light on the present constraints as well as possible uses of quantum computing in reinforcement learning, particularly in situations with intricate, high-dimensional settings that prove difficult for classical computers to handle effectively. As we look to the future, we suggest that investigating hybrid quantum-classical algorithms, developing quantum hardware, and using quantum RL for increasingly difficult tasks are essential first steps. The study presents findings from both a classical reinforcement learning algorithm and a quantum integrated reinforcement learning algorithm. To provide a reliable comparison between quantum reinforcement algorithms and their classical equivalents, further work remains. This work lays the groundwork for future advances in the field by investigating the viability and use of quantum algorithms in reinforcement learning, even if it is not particularly unique. The purpose of this work is to help newcomers to this emerging field of study.
The advantage of quantum computers over classical computers fuels the recent trend of developing machine learning algorithms on quantum computers, which can potentially lead to breakthroughs and new learning models in this area. The aim of our study is to explore deep quantum reinforcement learning (RL) on photonic quantum computers, which can process information stored in the quantum states of light. These quantum computers can naturally represent continuous variables, making them an ideal platform to create quantum versions of neural networks. Using quantum photonic circuits, we implement Q learning and actor-critic algorithms with multilayer quantum neural networks and test them in the grid world environment. Our experiments show that 1) these quantum algorithms can solve the RL problem and 2) compared to one layer, using three layer quantum networks improves the learning of both algorithms in terms of rewards collected. In summary, our findings suggest that having more layers in deep quantum RL can enhance the learning outcome.
With the evolution of technology, the need to solve complex computational problems like machine learning and deep learning has shot up. However, even the most powerful classical supercomputers find it difficult to execute these tasks. Advancements in quantum computing are leading researchers and tech-giants who strive for better quantum circuits to do machine learning tasks. Current works on Quantum Machine Learning (QML) ensure less memory consumption and reduced model parameters. However, it is strenuous to simulate the classical deep learning approach on existing quantum computing devices due to the inflexibility of Deep quantum circuits. Consequently, designing viable quantum algorithms for QML for noisy intermediate-scale quantum (NISQ) devices is essential. The proposed work aims to explore Variational Quantum Circuits (VQC) for Deep Q network-based Reinforcement Learning by remodeling the target network and experience replay into a representation of VQC. In addition, to the reduction in model parameters, quantum information encoding schemes are used to achieve better results than classical neural networks. VQCs are employed for policyselection and decision-making reinforcement learning by approximating the deep Q-value function with target network and experience replay.
Quantum Computing is a fastly growing area with many applications, including quantum machine learning (QML). Due to the rapid increase of computational power, machine learning models based on artificial neural networks (ANN) have become highly effective. Even though classical machine learning models have been performing well, quantum computing with machine learning enhances the performance in multiple ways. This paper studies different aspects of quantum machine learning. It introduces quantum computing over classical computation, followed by the recent tools and techniques developed in the area. We look at multiple QML models like quantum kernel, quantum support vector machine (QSVM), etc. Finally, we present the literature survey to encourage researchers and academicians.
Machine Learning (ML) has been widely applied across numerous domains due to its ability to automatically identify informative patterns from data for various tasks. The availability of large-scale data and advanced computational power enables the development of sophisticated models and training strategies, leading to state-of-the-art performance, but it also introduces substantial challenges. Quantum Computing (QC), which exploits quantum mechanisms for computation, has attracted growing attention and significant global investment as it may address these challenges. Consequently, Quantum Machine Learning (QML), the integration of these two fields, has received increasing interest, with a notable rise in related studies in recent years. We are motivated to review these existing contributions regarding quantum circuit-based learning models for classical data analysis and highlight the identified potentials and challenges of this technique. Specifically, we focus not only on QML models, both kernel-based and neural network-based, but also on recent explorations of their integration with classical machine learning layers within hybrid frameworks. Moreover, we examine both theoretical analysis and empirical findings to better understand their capabilities, and we also discuss the efforts on noise-resilient and hardware-efficient QML that could enhance its practicality under current hardware limitations. In addition, we cover several emerging paradigms for advanced quantum circuit design and highlight the adaptability of QML across representative application domains. This study aims to provide an overview of the contributions made to bridge quantum computing and machine learning, offering insights and guidance to support its future development and pave the way for broader adoption in the coming years.
Using quantum algorithms to improve deep learning models' capabilities is becoming increasingly popular as quantum computing develops. In this work, we investigate how quantum algorithms using quantum neural networks (QNNs) might enhance the effectiveness and performance of deep learning models. We examine the effects of quantum-inspired methods on tasks, including regression, sorting, and optimization, by thoroughly analyzing quantum algorithms and how they integrate with deep learning systems. We experiment with Estimator QNN and Sampler QNN implementations using Qiskit machine-learning, analyzing their forward and backward pass outcomes to assess the effectiveness of quantum algorithms in improving deep learning models. Our research clarifies the scope, intricacy, and scalability issues surrounding QNNs and offers insights into the possible advantages and difficulties of quantum-enhanced deep learning. This work adds to the continuing investigation of quantum computing's potential to advance machine learning and artificial intelligence paradigms by clarifying the interaction between quantum algorithms and deep learning systems.