Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2108.06849 · International Conference on Information and Communication Technology Convergence (ICTC)

Introduction to Quantum Reinforcement Learning: Theory and PennyLane-based Implementation

Yunseok Kwak, Won Joon Yun, Soyi Jung, Jong‐Kook Kim, Joongheon Kim

Published Oct 20, 2021• 62 citations
arXivHTMLPDF

Abstract

The emergence of quantum computing enables for researchers to apply quantum circuit on many existing studies. Utilizing quantum circuit and quantum differential programming, many research are conducted such as Quantum Machine Learning (QML). In particular, quantum reinforcement learning is a good field to test the possibility of quantum machine learning, and a lot of research is being done. This work will introduce the concept of quantum reinforcement learning using a variational quantum circuit, and confirm its possibility through implementation and experimentation. We will first present the background knowledge and working principle of quantum reinforcement learning, and then guide the implementation method using the PennyLane library. We will also discuss the power and possibility of quantum reinforcement learning from the experimental results obtained through this work.

DOI
10.1109/ictc52510.2021.9620885

Related papers

Quantum Machine Learning: Theory, Algorithms, and Practical Implementation

Hamid D. Ismail

Quantum machine learning (QML) has emerged as a rapidly developing field at the intersection of quantum computing, artificial intelligence, and data science. As quantum hardware and algorithms continue to advance, there is a growing need for a rigorous and accessible text that explains how quantum principles can be used to design, analyze, and implement machine learning models. This book is intended for graduate students, researchers, and practitioners in computer science, physics, engineering, mathematics, and related disciplines. This book provides a comprehensive introduction to the foundations and modern methods of QML. It begins with the principles of quantum information, Hilbert spaces, quantum circuits, and quantum algorithms relevant to learning tasks. Then, it develops the major paradigms of the field, including quantum data encoding, quantum feature maps and kernels, variational quantum circuits, quantum neural networks, quantum generative models, quantum reinforcement learning, quantum transfer learning, and quantum linear algebra techniques. The text emphasizes both theory and implementation, with programming examples and computational workflows using Qiskit, PennyLane, TensorFlow Quantum, and PyTorch. Additional chapters address tensor network-inspired learning, error mitigation, graphics processing unit (GPU)-accelerated simulation, benchmarking, hybrid quantum-classical architectures, and applications in chemistry, genomics, finance, optimization, and natural language processing. Distinctive in both scope and organization, the book integrates mathematical foundations, algorithmic development, software implementation, and emerging research directions within a single coherent framework, making it suitable both as a graduate-level textbook and as a practical reference for researchers working in QML.

CRC Press eBooks•Nov 4, 2026•0 citations

A Systematic Introduction to Quantum Computing and Quantum Machine Learning for IoT Applications

Mathew Vincent, Parvathy Gopakumar, Asha Sebastian +1 more

This chapter provides a beginner-friendly introduction to quantum machine learning (QML). We begin by exploring basic principles of quantum computing and its practical implementation using quantum circuits. We also look at creating and visualizing the quantum circuit using PennyLane. The core focus then shifts to data encoding and processing using variational quantum algorithms including hybrid quantum–classical algorithms. This chapter includes examples of PennyLane pseudo code, guiding readers through implementing basic QML algorithms. The chapter concludes with a discussion on how quantum technologies can play a pivotal role in advancing future IoT systems.

Wiley eBooks•May 22, 2026•0 citations

Implementation of Quantum Deep Reinforcement Learning Using Variational Quantum Circuits

S Lokes, C. Sakthi Jay Mahenthar, S Parvatha Kumaran +2 more

With the evolution of technology, the need to solve complex computational problems like machine learning and deep learning has shot up. However, even the most powerful classical supercomputers find it difficult to execute these tasks. Advancements in quantum computing are leading researchers and tech-giants who strive for better quantum circuits to do machine learning tasks. Current works on Quantum Machine Learning (QML) ensure less memory consumption and reduced model parameters. However, it is strenuous to simulate the classical deep learning approach on existing quantum computing devices due to the inflexibility of Deep quantum circuits. Consequently, designing viable quantum algorithms for QML for noisy intermediate-scale quantum (NISQ) devices is essential. The proposed work aims to explore Variational Quantum Circuits (VQC) for Deep Q network-based Reinforcement Learning by remodeling the target network and experience replay into a representation of VQC. In addition, to the reduction in model parameters, quantum information encoding schemes are used to achieve better results than classical neural networks. VQCs are employed for policyselection and decision-making reinforcement learning by approximating the deep Q-value function with target network and experience replay.

International Conference on Trends in Quantum Computing and Emerging Business Technologies (TQCEBT)•Oct 13, 2022•21 citations

Hybrid Quantum-Classical Machine Learning with PennyLane: A Comprehensive Guide for Computational Research

Sidney Shapiro

Hybrid quantum-classical machine learning represents a frontier in computational research, combining the potential advantages of quantum computing with established classical optimization techniques. PennyLane provides a Python framework that seamlessly bridges quantum circuits and classical machine learning, enabling researchers to build, optimize, and deploy variational quantum algorithms. This paper introduces PennyLane as a versatile tool for quantum machine learning, optimization, and quantum chemistry applications. We demonstrate use cases including quantum kernel methods, variational quantum eigensolvers, portfolio optimization, and integration with classical ML frameworks such as PyTorch, TensorFlow, and JAX. Through concrete Python examples with widely used libraries such as scikit-learn, pandas, and matplotlib, we show how PennyLane facilitates efficient quantum circuit construction, automatic differentiation, and hybrid optimization workflows. By situating PennyLane within the broader context of quantum computing and machine learning, we highlight its role as a methodological building block for quantum-enhanced data science. Our goal is to provide researchers and practitioners with a concise reference that bridges foundational quantum computing concepts and applied machine learning practice, making PennyLane a default citation for hybrid quantum-classical workflows in Python-based research.

arXiv:2511.14786•Nov 13, 2025•3 citations

An Introduction to Quantum Machine Learning for Engineers

Osvaldo Simeone

This monograph is motivated by a number of recent developments that appear to define a possible new role for researchers with an engineering profile. First, there are now several software libraries – such as IBM’s Qiskit, Google’s Cirq, and Xanadu’s PennyLane – that make programming quantum algorithms more accessible, while also providing cloud-based access to actual quantum computers. Second, a new framework is emerging for programming quantum algorithms to be run on current quantum hardware: quantum machine learning. In the current noisy intermediate-scale quantum (NISQ) era, quantum machine learning is emerging as a dominant paradigm to program gate-based quantum computers. In quantum machine learning, the gates of a quantum circuit are parametrized, and the parameters are tuned via classical optimization based on data and on measurements of the outputs of the circuit. Parametrized quantum circuits (PQCs) can efficiently address combinatorial optimization problems, implement probabilistic generative models, and carry out inference (classification and regression). This monograph provides a self-contained introduction to quantum machine learning for an audience of engineers with a background in probability and linear algebra. It first describes the background, concepts, and tools necessary to describe quantum operations and measurements. Then, it covers parametrized quantum circuits, the variational quantum eigensolver, as well as unsupervised and supervised quantum machine learning formulations.

•Jan 1, 2022•8 citations

Introduction to Quantum Machine Learning

Sefrin, Oliver

In this tutorial, we will have a first look at variational quantum machine learning (QML), which combines parametrized quantum circuits as models with a classical optimization loop. We start with a brief overview of quantum computing, highlighting its potential as well as its current limitations. Next, using the popular QML framework PennyLane, we show how to build a quantum model and integrate it into standard TensorFlow- or Torch-based ML workflows. Finally, we address pros and cons of QML and discuss open challenges in the field.

•Sep 23, 2024•0 citations
The emergence of quantum computing enables for researchers to apply quantum circuit on many existing studies. Utilizing quantum circuit and quantum differential programming, many research are conducted such as Quantum Machine Learning (QML). In particular, quantum reinforcement learning is a good field to test the possibility of quantum machine learning, and a lot of research is being done. This work will introduce the concept of quantum reinforcement learning using a variational quantum circuit, and confirm its possibility through implementation and experimentation. We will first present the background knowledge and working principle of quantum reinforcement learning, and then guide the implementation method using the PennyLane library. We will also discuss the power and possibility of quantum reinforcement learning from the experimental results obtained through this work.
Quantum machine learning (QML) has emerged as a rapidly developing field at the intersection of quantum computing, artificial intelligence, and data science. As quantum hardware and algorithms continue to advance, there is a growing need for a rigorous and accessible text that explains how quantum principles can be used to design, analyze, and implement machine learning models. This book is intended for graduate students, researchers, and practitioners in computer science, physics, engineering, mathematics, and related disciplines. This book provides a comprehensive introduction to the foundations and modern methods of QML. It begins with the principles of quantum information, Hilbert spaces, quantum circuits, and quantum algorithms relevant to learning tasks. Then, it develops the major paradigms of the field, including quantum data encoding, quantum feature maps and kernels, variational quantum circuits, quantum neural networks, quantum generative models, quantum reinforcement learning, quantum transfer learning, and quantum linear algebra techniques. The text emphasizes both theory and implementation, with programming examples and computational workflows using Qiskit, PennyLane, TensorFlow Quantum, and PyTorch. Additional chapters address tensor network-inspired learning, error mitigation, graphics processing unit (GPU)-accelerated simulation, benchmarking, hybrid quantum-classical architectures, and applications in chemistry, genomics, finance, optimization, and natural language processing. Distinctive in both scope and organization, the book integrates mathematical foundations, algorithmic development, software implementation, and emerging research directions within a single coherent framework, making it suitable both as a graduate-level textbook and as a practical reference for researchers working in QML.
This chapter provides a beginner-friendly introduction to quantum machine learning (QML). We begin by exploring basic principles of quantum computing and its practical implementation using quantum circuits. We also look at creating and visualizing the quantum circuit using PennyLane. The core focus then shifts to data encoding and processing using variational quantum algorithms including hybrid quantum–classical algorithms. This chapter includes examples of PennyLane pseudo code, guiding readers through implementing basic QML algorithms. The chapter concludes with a discussion on how quantum technologies can play a pivotal role in advancing future IoT systems.
With the evolution of technology, the need to solve complex computational problems like machine learning and deep learning has shot up. However, even the most powerful classical supercomputers find it difficult to execute these tasks. Advancements in quantum computing are leading researchers and tech-giants who strive for better quantum circuits to do machine learning tasks. Current works on Quantum Machine Learning (QML) ensure less memory consumption and reduced model parameters. However, it is strenuous to simulate the classical deep learning approach on existing quantum computing devices due to the inflexibility of Deep quantum circuits. Consequently, designing viable quantum algorithms for QML for noisy intermediate-scale quantum (NISQ) devices is essential. The proposed work aims to explore Variational Quantum Circuits (VQC) for Deep Q network-based Reinforcement Learning by remodeling the target network and experience replay into a representation of VQC. In addition, to the reduction in model parameters, quantum information encoding schemes are used to achieve better results than classical neural networks. VQCs are employed for policyselection and decision-making reinforcement learning by approximating the deep Q-value function with target network and experience replay.
Hybrid quantum-classical machine learning represents a frontier in computational research, combining the potential advantages of quantum computing with established classical optimization techniques. PennyLane provides a Python framework that seamlessly bridges quantum circuits and classical machine learning, enabling researchers to build, optimize, and deploy variational quantum algorithms. This paper introduces PennyLane as a versatile tool for quantum machine learning, optimization, and quantum chemistry applications. We demonstrate use cases including quantum kernel methods, variational quantum eigensolvers, portfolio optimization, and integration with classical ML frameworks such as PyTorch, TensorFlow, and JAX. Through concrete Python examples with widely used libraries such as scikit-learn, pandas, and matplotlib, we show how PennyLane facilitates efficient quantum circuit construction, automatic differentiation, and hybrid optimization workflows. By situating PennyLane within the broader context of quantum computing and machine learning, we highlight its role as a methodological building block for quantum-enhanced data science. Our goal is to provide researchers and practitioners with a concise reference that bridges foundational quantum computing concepts and applied machine learning practice, making PennyLane a default citation for hybrid quantum-classical workflows in Python-based research.
This monograph is motivated by a number of recent developments that appear to define a possible new role for researchers with an engineering profile. First, there are now several software libraries – such as IBM’s Qiskit, Google’s Cirq, and Xanadu’s PennyLane – that make programming quantum algorithms more accessible, while also providing cloud-based access to actual quantum computers. Second, a new framework is emerging for programming quantum algorithms to be run on current quantum hardware: quantum machine learning. In the current noisy intermediate-scale quantum (NISQ) era, quantum machine learning is emerging as a dominant paradigm to program gate-based quantum computers. In quantum machine learning, the gates of a quantum circuit are parametrized, and the parameters are tuned via classical optimization based on data and on measurements of the outputs of the circuit. Parametrized quantum circuits (PQCs) can efficiently address combinatorial optimization problems, implement probabilistic generative models, and carry out inference (classification and regression). This monograph provides a self-contained introduction to quantum machine learning for an audience of engineers with a background in probability and linear algebra. It first describes the background, concepts, and tools necessary to describe quantum operations and measurements. Then, it covers parametrized quantum circuits, the variational quantum eigensolver, as well as unsupervised and supervised quantum machine learning formulations.
In this tutorial, we will have a first look at variational quantum machine learning (QML), which combines parametrized quantum circuits as models with a classical optimization loop. We start with a brief overview of quantum computing, highlighting its potential as well as its current limitations. Next, using the popular QML framework PennyLane, we show how to build a quantum model and integrate it into standard TensorFlow- or Torch-based ML workflows. Finally, we address pros and cons of QML and discuss open challenges in the field.