arXiv:1904.02467 · Journal of Physics A Mathematical and Theoretical

Neural network agent playing spin Hamiltonian games on a quantum computer

Oleg M Sotnikov, Vladimir V Mazurenko

Published Feb 7, 2020• 6 citations

Abstract

Abstract Quantum computing is expected to provide new promising approaches for solving the most challenging problems in material science, communication, search, machine learning and other domains. However, due to the decoherence and gate imperfection errors modern quantum computer systems are characterized by a very complex, dynamical, uncertain and fluctuating computational environment. We develop an autonomous agent effectively interacting with such an environment to solve magnetism problems. By using reinforcement learning the agent is trained to find the best-possible approximation of a spin Hamiltonian ground state from self-play on quantum devices. We show that the agent can learn the entanglement to imitate the ground state of the quantum spin dimer. The experiments were conducted on quantum computers provided by IBM. To compensate the decoherence we use a local spin correction procedure derived from a general sum rule for spin–spin correlation functions of a quantum system with an even number of antiferromagnetically-coupled spins in the ground state. Our study paves a way to create a new family of neural network eigensolvers for quantum computers.

DOI: 10.1088/1751-8121/ab73ad

Related papers

NEURAL NETWORK AGENT PLAYING SPIN HAMILTONIAN GAMES ON A QUANTUM COMPUTER

Sotnikov, O. M., Mazurenko, V. V.

We develop an autonomous agent effectively interacting with noisy quantum computer to solve magnetism problems. By using the reinforcement learning the agent is trained to find the best-possible approximation of a spin Hamiltonian ground state from self-conducted ex-periments on quantum devices.

Jan 1, 20206 citations

Reinforcement Learning with Neural Networks for Quantum Feedback

Thomas Fösel, Petru Tighineanu, Talitha Weiss +1 more

Machine learning with artificial neural networks is revolutionizing science.The most advanced challenges require discovering answers autonomously.In the domain of reinforcement learning, control strategies are improved according to a reward function.The power of neural-network-based reinforcement learning has been highlighted by spectacular recent successes such as playing Go, but its benefits for physics are yet to be demonstrated.Here, we show how a network-based "agent" can discover complete quantum-error-correction strategies, protecting a collection of qubits against noise.These strategies require feedback adapted to measurement outcomes.Finding them from scratch without human guidance and tailored to different hardware resources is a formidable challenge due to the combinatorially large search space.To solve this challenge, we develop two ideas: two-stage learning with teacher and student networks and a reward quantifying the capability to recover the quantum information stored in a multiqubit system.Beyond its immediate impact on quantum computation, our work more generally demonstrates the promise of neural-network-based reinforcement learning in physics.

arXiv:1802.05267Physical Review XSep 27, 2018231 citations

Solving the quantum many-body problem with artificial neural networks

Giuseppe Carleo, Matthias Troyer

The challenge posed by the many-body problem in quantum physics originates from the difficulty of describing the nontrivial correlations encoded in the exponential complexity of the many-body wave function. Here we demonstrate that systematic machine learning of the wave function can reduce this complexity to a tractable computational form for some notable cases of physical interest. We introduce a variational representation of quantum states based on artificial neural networks with a variable number of hidden neurons. A reinforcement-learning scheme we demonstrate is capable of both finding the ground state and describing the unitary time evolution of complex interacting quantum systems. Our approach achieves high accuracy in describing prototypical interacting spins models in one and two dimensions.

arXiv:1606.02318ScienceFeb 10, 20172,210 citations

Machine Learning Representations of Many-Body Quantum Spin Systems

Jonathan Minoff

Neural network approaches to machine learning problems rely on statistical frameworks that are designed to generalize to many situations, whereas traditional physics-based approaches to quantum problems stem from specific physical laws that govern the behavior of certain classes of systems. While quantum physics and machine learning have been largely disparate fields for most of their history, their interplay has gained considerable attention in recent years, primarily driven by the premise that the most powerful computational models are those whose foundations stem from both physical and statistical principles. Two overarching strategies in this area include building physics-based machine learning models from the ground up, or alternatively, looking for hidden ways that statistical models include aspects of physical systems. Many-body quantum systems turn out to be a useful testing ground for both of these approaches, due to the complex behavior that arises from simple fundamental rules. Here, we present several ways that neural networks can represent many-body spin states, which enables the exploration into the underlying nature of neural networks, as well as gaining insight into how effective different classes of models are for simulating physical systems. The main focus areas of this thesis are (1) connecting convolutional neural networks to maximum-entropy distributions when applied to spin systems, (2) using generative models to gain physical insights into experimental tomographic data, and (3) applying inverse reinforcement learning to probe the nature of agent-based quantum circuit design.

Dec 1, 20250 citations

Quantum machine learning for autonomous agents

Meenakshi Munjal, Rajanish Kumar Kaushal

Autonomous agents are being used in more complex and dynamic environments where efficient learning, adaptive decision-making, and scalable optimization are required. Although classical machine learning (ML) and reinforcement methods have greatly contributed to agent intelligence, they are usually restricted by constraints of computational complexity, scaling, and convergence to high-dimensional decision space. The current developments in quantum computing have created new possibilities to solve these problems using quantum ML (QML). In this chapter, the authors discuss the implementation of QML in collaboration with autonomous agents in the larger paradigm of agentic artificial intelligence (AI) and quantum AI agents. It offers a hybrid classical–quantum architectural model where quantum learning modules improve perception, policy learning, and decision optimization, and do not conflict with classical agent pipelines. The chapter analyzes application cases in autonomous robotics, intelligent transportation systems, multi-agent coordination, smart energy management, as well as communication networks, and the chapter shows the potential benefits of quantum-enhanced learning in these areas. The issue of quantum hardware neediness, data encoding, scaling, hybrid integration, and real-life application are critically evaluated and unanswered. In summary, the chapter is a well-organized approach to the purpose of QML in the development of the next-generation autonomous agent and an insight into creating practical, scalable, and intelligent quantum AI agents.

CRC Press eBooksOct 21, 20260 citations

Quantum Machine Learning: A Reinforcement Learning Framework

Jincheng Zhang

Quantum Machine Learning (QML) represents a paradigm shift in machine learning, leveraging quantum mechanical principles to accelerate computation and potentially unlock new algorithms. This paper investigates a novel reinforcement learning (RL) framework, termed "Adaptive Neural Network Reinforcement Learning" (ANNR), which employs dynamic parameter adjustment within a self-adaptive neural network to enhance learning efficiency and generalization capabilities. We demonstrate that this approach overcomes limitations of traditional RL methods, offering a promising path towards more robust and adaptable reinforcement learning agents. The core mechanism focuses on iteratively refining neural network weights through a feedback loop, enabling the system to explore complex environments effectively. The research explores the impact of parameter adjustment on both training speed and final performance across various RL tasks.

Aug 31, 20260 citations