Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2601.05577 · Journal of Statistical Mechanics Theory and Experiment

Autonomous discovery of the Ising model’s critical parameters with reinforcement learning

Hai Man, Chaobo Wang, Jia‐Rui Li, Yu-Ping Tian, S. J. Chen

Published Dec 1, 2025• 0 citations
arXivHTMLPDF

Abstract

Abstract Traditional methods for determining critical parameters are often influenced by human factors. This study introduces a physics-inspired adaptive reinforcement learning framework that enables agents to autonomously interact with physical environments, simultaneously identifying both the critical temperature and various types of critical exponents in the Ising model with precision. Interestingly, our algorithm exhibits search behavior reminiscent of phase transitions, efficiently converging to target parameters regardless of initial conditions. Experimental results demonstrate that this method significantly outperforms traditional approaches, particularly in environments with strong perturbations. This study not only incorporates physical concepts into machine learning to enhance algorithm interpretability but also establishes a new paradigm for scientific exploration, transitioning from manual analysis to autonomous AI discovery.

DOI
10.1088/1742-5468/ae22ea

Related papers

Quantum Machine Learning: A Reinforcement Learning Framework

Jincheng Zhang

Quantum Machine Learning (QML) represents a paradigm shift in machine learning, leveraging quantum mechanical principles to accelerate computation and potentially unlock new algorithms. This paper investigates a novel reinforcement learning (RL) framework, termed "Adaptive Neural Network Reinforcement Learning" (ANNR), which employs dynamic parameter adjustment within a self-adaptive neural network to enhance learning efficiency and generalization capabilities. We demonstrate that this approach overcomes limitations of traditional RL methods, offering a promising path towards more robust and adaptable reinforcement learning agents. The core mechanism focuses on iteratively refining neural network weights through a feedback loop, enabling the system to explore complex environments effectively. The research explores the impact of parameter adjustment on both training speed and final performance across various RL tasks.

•Aug 31, 2026•0 citations

基于量子机器学习的非线性强化学习的自适应算法

Jincheng Zhang

This paper presents a novel approach to reinforcement learning, leveraging the unique capabilities of quantum machine learning to develop an adaptive learning algorithm. Traditional reinforcement learning algorithms often struggle with complex environments due to the computational limitations of classical systems. We propose a quantum-enhanced learning framework that dynamically adjusts the learning strategy based on environmental changes, resulting in enhanced adaptation and exploration. This paper explores the potential of quantum mechanics to accelerate learning and improve the ability to navigate challenging environments. The core mechanism focuses on utilizing quantum entanglement and superposition to represent and update the state space more efficiently, facilitating faster convergence and the discovery of optimal policies. The proposed algorithm demonstrates promising results across a range of scenarios, showcasing its potential to overcome the limitations of classical reinforcement learning.

•Aug 31, 2026•0 citations

Quantum-Inspired Optimization of Reinforcement Learning Policies

Jincheng Zhang

This paper investigates the potential of utilizing quantum-inspired optimization techniques to enhance reinforcement learning (RL) policies. Traditional RL algorithms often suffer from slow convergence and can be trapped in local optima. We propose leveraging quantum annealing, a prominent quantum computing paradigm, to optimize the policy parameters within an RL framework. The core idea is to map the policy optimization problem onto an Ising model, which is then solved using quantum annealing algorithms. This approach aims to provide a more efficient search process, potentially leading to faster learning rates and improved policy performance. We explore the theoretical underpinnings of this approach and present a conceptual framework for its implementation. The primary focus is on demonstrating the feasibility and potential benefits of this novel hybrid approach, rather than a full-fledged experimental validation due to the limitations of current quantum annealing hardware. The paper concludes with a discussion of future research directions and challenges.

•Aug 28, 2026•0 citations

Quantum-Inspired Algorithms for Reinforcement Learning Policy Optimization

Jincheng Zhang

This paper investigates the potential of quantum-inspired algorithms to improve reinforcement learning (RL) policy optimization. Traditional RL methods often struggle with slow convergence and exploration challenges, particularly in complex environments. We propose a novel approach that draws inspiration from quantum mechanics, specifically superposition and entanglement, to address these limitations. Our algorithms aim to exploit superposition to simultaneously evaluate multiple action possibilities and utilize entanglement to model correlations between states, thereby accelerating the learning process. We present a framework for incorporating these concepts into RL, focusing on algorithmic design rather than a direct quantum simulation. The theoretical analysis suggests that our approach could significantly enhance exploration efficiency and, consequently, policy convergence rates. This work represents a direct application of quantum-inspired ideas to RL policy optimization, offering a potentially transformative pathway for developing more efficient and robust RL agents.

•Sep 7, 2026•0 citations

Adaptive Quantum Environment Reinforcement Learning

Jincheng Zhang

This paper introduces an adaptive quantum environment reinforcement learning framework, aiming to achieve precise modeling and prediction of quantum system behavior. Traditional reinforcement learning relies on static environments, limiting its applicability to complex systems. Our proposed method dynamically adjusts the quantum environment to guide the system towards desired states, offering a significant improvement in performance compared to conventional approaches. We detail the core mechanism, utilizing quantum environment dynamics to create a self-optimizing learning process. The study addresses the limitations of traditional reinforcement learning by incorporating a dynamic environment, leading to enhanced precision and adaptability. This work presents a novel framework with potential applications in diverse quantum computing tasks and simulations.

•Aug 31, 2026•0 citations

Empowering Autonomous Decision-Making Through Quantum Reinforcement Learning and Cognitive Neuromorphic Frameworks

Balasubramani R, Vidyadevi G. Biradar

The concept of Agentic AI, which focuses on empowering autonomous systems with human-like decision-making capabilities, has gained substantial attention in recent years. By leveraging advanced reinforcement learning (RL) techniques and cognitive frameworks, Agentic AI aims to enable machines to make complex decisions in dynamic environments with minimal human intervention. This paper introduces Agentic AI, a novel approach that combines Quantum Reinforcement Learning (QRL) and Cognitive Neuromorphic Frameworks to empower autonomous decision-making in complex environments. The proposed model leverages quantum computing principles to accelerate learning in reinforcement-based systems, while cognitive neuromorphic frameworks enhance adaptability and real-time decision-making by mimicking human brain functionality. The integration of QRL allows for faster convergence in learning algorithms, improving decision accuracy by 25% and reducing training time by 40%. Cognitive neuromorphic architectures offer enhanced scalability and resilience in dynamic environments, resulting in a 35% improvement in system robustness during testing. Simulations in autonomous navigation and robotic control show that Agentic AI achieves 20% more efficient task execution compared to traditional AI models. These values underscore the potential of the proposed system to revolutionize autonomous systems, providing a robust foundation for decision-making across a range of applications.

International Conference on Mobile Networks and Wireless Communications (ICMNWC)•Dec 4, 2024•4 citations
Abstract Traditional methods for determining critical parameters are often influenced by human factors. This study introduces a physics-inspired adaptive reinforcement learning framework that enables agents to autonomously interact with physical environments, simultaneously identifying both the critical temperature and various types of critical exponents in the Ising model with precision. Interestingly, our algorithm exhibits search behavior reminiscent of phase transitions, efficiently converging to target parameters regardless of initial conditions. Experimental results demonstrate that this method significantly outperforms traditional approaches, particularly in environments with strong perturbations. This study not only incorporates physical concepts into machine learning to enhance algorithm interpretability but also establishes a new paradigm for scientific exploration, transitioning from manual analysis to autonomous AI discovery.
Quantum Machine Learning (QML) represents a paradigm shift in machine learning, leveraging quantum mechanical principles to accelerate computation and potentially unlock new algorithms. This paper investigates a novel reinforcement learning (RL) framework, termed "Adaptive Neural Network Reinforcement Learning" (ANNR), which employs dynamic parameter adjustment within a self-adaptive neural network to enhance learning efficiency and generalization capabilities. We demonstrate that this approach overcomes limitations of traditional RL methods, offering a promising path towards more robust and adaptable reinforcement learning agents. The core mechanism focuses on iteratively refining neural network weights through a feedback loop, enabling the system to explore complex environments effectively. The research explores the impact of parameter adjustment on both training speed and final performance across various RL tasks.
This paper presents a novel approach to reinforcement learning, leveraging the unique capabilities of quantum machine learning to develop an adaptive learning algorithm. Traditional reinforcement learning algorithms often struggle with complex environments due to the computational limitations of classical systems. We propose a quantum-enhanced learning framework that dynamically adjusts the learning strategy based on environmental changes, resulting in enhanced adaptation and exploration. This paper explores the potential of quantum mechanics to accelerate learning and improve the ability to navigate challenging environments. The core mechanism focuses on utilizing quantum entanglement and superposition to represent and update the state space more efficiently, facilitating faster convergence and the discovery of optimal policies. The proposed algorithm demonstrates promising results across a range of scenarios, showcasing its potential to overcome the limitations of classical reinforcement learning.
This paper investigates the potential of utilizing quantum-inspired optimization techniques to enhance reinforcement learning (RL) policies. Traditional RL algorithms often suffer from slow convergence and can be trapped in local optima. We propose leveraging quantum annealing, a prominent quantum computing paradigm, to optimize the policy parameters within an RL framework. The core idea is to map the policy optimization problem onto an Ising model, which is then solved using quantum annealing algorithms. This approach aims to provide a more efficient search process, potentially leading to faster learning rates and improved policy performance. We explore the theoretical underpinnings of this approach and present a conceptual framework for its implementation. The primary focus is on demonstrating the feasibility and potential benefits of this novel hybrid approach, rather than a full-fledged experimental validation due to the limitations of current quantum annealing hardware. The paper concludes with a discussion of future research directions and challenges.
This paper investigates the potential of quantum-inspired algorithms to improve reinforcement learning (RL) policy optimization. Traditional RL methods often struggle with slow convergence and exploration challenges, particularly in complex environments. We propose a novel approach that draws inspiration from quantum mechanics, specifically superposition and entanglement, to address these limitations. Our algorithms aim to exploit superposition to simultaneously evaluate multiple action possibilities and utilize entanglement to model correlations between states, thereby accelerating the learning process. We present a framework for incorporating these concepts into RL, focusing on algorithmic design rather than a direct quantum simulation. The theoretical analysis suggests that our approach could significantly enhance exploration efficiency and, consequently, policy convergence rates. This work represents a direct application of quantum-inspired ideas to RL policy optimization, offering a potentially transformative pathway for developing more efficient and robust RL agents.
This paper introduces an adaptive quantum environment reinforcement learning framework, aiming to achieve precise modeling and prediction of quantum system behavior. Traditional reinforcement learning relies on static environments, limiting its applicability to complex systems. Our proposed method dynamically adjusts the quantum environment to guide the system towards desired states, offering a significant improvement in performance compared to conventional approaches. We detail the core mechanism, utilizing quantum environment dynamics to create a self-optimizing learning process. The study addresses the limitations of traditional reinforcement learning by incorporating a dynamic environment, leading to enhanced precision and adaptability. This work presents a novel framework with potential applications in diverse quantum computing tasks and simulations.
The concept of Agentic AI, which focuses on empowering autonomous systems with human-like decision-making capabilities, has gained substantial attention in recent years. By leveraging advanced reinforcement learning (RL) techniques and cognitive frameworks, Agentic AI aims to enable machines to make complex decisions in dynamic environments with minimal human intervention. This paper introduces Agentic AI, a novel approach that combines Quantum Reinforcement Learning (QRL) and Cognitive Neuromorphic Frameworks to empower autonomous decision-making in complex environments. The proposed model leverages quantum computing principles to accelerate learning in reinforcement-based systems, while cognitive neuromorphic frameworks enhance adaptability and real-time decision-making by mimicking human brain functionality. The integration of QRL allows for faster convergence in learning algorithms, improving decision accuracy by 25% and reducing training time by 40%. Cognitive neuromorphic architectures offer enhanced scalability and resilience in dynamic environments, resulting in a 35% improvement in system robustness during testing. Simulations in autonomous navigation and robotic control show that Agentic AI achieves 20% more efficient task execution compared to traditional AI models. These values underscore the potential of the proposed system to revolutionize autonomous systems, providing a robust foundation for decision-making across a range of applications.