Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2411.07144 · Physical Review Research

Autoregressive neural quantum states of Fermi Hubbard models

Eduardo Ibarra-García-Padilla, Hannah Lange, Roger G. Melko, Richard T. Scalettar, Juan Carrasquilla, Annabelle Bohrdt, Ehsan Khatami

Published Feb 3, 2025• 9 citations
arXivHTMLPDF

Abstract

Neural quantum states (NQSs) have emerged as a powerful ansatz for variational quantum Monte Carlo studies of strongly correlated systems. Here, we apply recurrent neural networks (RNNs) and autoregressive transformer neural networks to the Fermi-Hubbard and the (non-Hermitian) Hatano-Nelson-Hubbard models in one and two dimensions. In both cases, we observe that the convergence of the RNN ansatz is challenged when increasing the interaction strength. We present a physically motivated and easy-to-implement strategy for improving the optimization, namely, by ramping of the model parameters. Furthermore, we investigate the advantages and disadvantages of the autoregressive sampling property of both network architectures. For the Hatano-Nelson-Hubbard model, we identify convergence issues that stem from the autoregressive sampling scheme in combination with the non-Hermitian nature of the model. Our findings provide insights into the challenges of the NQS approach and make the first step towards exploring strongly correlated electrons using this ansatz.

DOI
10.1103/physrevresearch.7.013122

Related papers

Entanglement and optimization within autoregressive neural quantum states

Andrew Jreissaty, Hang Zhang, Jairo C. Quijano +2 more

Neural quantum states (NQSs) are powerful variational ansätze capable of representing highly entangled quantum many-body wavefunctions. While the average entanglement properties of ensembles of restricted Boltzmann machines are well understood, the entanglement structure of autoregressive NQSs such as recurrent neural networks and transformers remains largely unexplored. We perform large-scale simulations of ensembles of random autoregressive wavefunctions for chains of up to 256 spins and uncover signatures of transitions in their average entanglement scaling, entanglement spectra, and correlation functions. We show that the standard softmax normalization of the wavefunction suppresses entanglement and fluctuations, and introduce a square modulus normalization function that restores them. Finally, we connect the insights gained from our entanglement and activation function analysis to initialization strategies for finding the ground states of strongly correlated Hamiltonians via variational Monte Carlo.

arXiv:2509.12365•Physical Review Research•Jan 12, 2026•0 citations

Autoregressive Projective Quantum Monte Carlo: From a Hermitian to a Non-Hermitian Perspective

Lavoisier Wah, Remmy Zen, Flore K. Kunst

Accurately determining the ground-state properties of quantum many-body systems remains a central challenge. In this work, we introduce an autoregressive projective quantum Monte Carlo (PQMC) framework that leverages recurrent neural networks (RNNs) to guide the stochastic dynamics. By incorporating autoregressive sampling into PQMC, we demonstrate substantial improvements in accuracy compared to standard unguided PQMC, while retaining polynomial computational cost. We benchmark our approach against conventional variational RNN ansätze and find that the autoregressive PQMC consistently achieves lower energies and higher fidelity, regardless of system size or whether the Hamiltonian is Hermitian or non-Hermitian. Our results highlight the versatility and power of neural-guided PQMC methods, paving the way for promising scalable simulations of low-energy states in complex quantum many-body systems.

quant-pharXiv:2608.09496•Aug 11, 2026•0 citations

Neural network approach to quasiparticle dispersions in doped antiferromagnets

Hannah Lange, Fabian Döschl, Juan Carrasquilla +1 more

Abstract Numerically simulating large, spinful, fermionic systems is of great interest in condensed matter physics. However, the exponential growth of the Hilbert space dimension with system size renders exact quantum state parameterizations impractical. Owing to their representative power, neural networks often allow to overcome this exponential scaling. Here, we investigate the ability of neural quantum states (NQS) to represent the bosonic and fermionict − Jmodel – the high interaction limit of the Hubbard model – on various 1D and 2D lattices. Using autoregressive, tensorized recurrent neural networks (RNNs), we study ground state representations upon hole doping the half-filled system. Additionally, we propose a method to calculate quasiparticle dispersions, applicable to any network architecture or lattice geometry, and allowing to infer the low-energy physics from NQS. By analyzing the strengths and weaknesses of the RNN ansatz we shed light on the challenges and promises of NQS for simulating bosonic and fermionic systems.

arXiv:2310.08578•Communications Physics•Jun 12, 2024•18 citations

Parallel Scan Recurrent Neural Quantum States for Scalable Variational Monte Carlo

Ejaaz Merali, Mohamed Hibat-Allah, Mohammad Kohandel +2 more

Neural-network quantum states have emerged as a powerful variational framework for quantum many-body systems, with recent progress often driven by massively parallel architectures such as transformers. Recurrent neural network quantum states, however, are frequently regarded as intrinsically sequential and therefore less scalable. Here we revisit this view by showing that modern recurrent architectures can support fast, accurate, and computationally accessible neural quantum state simulations. Using autoregressive recurrent wave functions together with recent advances in parallelizable recurrence, we develop variational ansätze, called parallel scan recurrent neural quantum states (PSR-NQS), which can be trained efficiently within variational Monte Carlo in one and two spatial dimensions. We demonstrate accurate benchmark results and show that, with iterative retraining, our approach reaches two-dimensional spin lattices as large as $52\times52$ while remaining in agreement with available quantum Monte Carlo data. Our results establish recurrent architectures as a practical and promising route toward scalable neural quantum state simulations with modest computational resources.

cond-mat.str-elCross-listedarXiv:2605.13807•May 14, 2026•0 citations

Adaptive neural quantum states: a recurrent neural network perspective

Jake McNaughton, Mohamed Hibat-Allah

Abstract Neural-network quantum states (NQS) are powerful neural-network ansätzes that have emerged as promising tools for studying quantum many-body physics through the lens of the variational principle. These architectures are known to be systematically improvable by increasing the number of parameters. Here we demonstrate an Adaptive scheme to optimize NQSs, through the example of recurrent neural networks (RNNs), using a fraction of the computation cost while reducing training fluctuations and improving the quality of variational calculations targeting ground states of prototypical models in one- and two-spatial dimensions. This Adaptive framework reduces the computational cost through training small RNNs and reusing them to initialize larger RNNs. This work opens up the possibility for optimizing graphical processing unit resources deployed in large-scale NQS simulations.

arXiv:2507.18700•Machine Learning Science and Technology•Sep 15, 2026•0 citations

Autoregressive Neural Quantum States with Quantum Number Symmetries

Aleksei Malyshev, Juan Miguel Arrazola, Alexander I. Lvovsky

Neural quantum states have established themselves as a powerful and versatile family of ansatzes for variational Monte Carlo simulations of quantum many-body systems. Of particular prominence are autoregressive neural quantum states (ANQS), which enjoy the expressibility of deep neural networks, and are equipped with a procedure for fast and unbiased sampling. Yet, the non-selective nature of autoregressive sampling makes incorporating quantum number symmetries challenging. In this work, we develop a general framework to make the autoregressive sampling compliant with an arbitrary number of quantum number symmetries. We showcase its advantages by running electronic structure calculations for a range of molecules with multiple symmetries of this kind. We reach the level of accuracy reported in previous works with more than an order of magnitude speedup and achieve chemical accuracy for all studied molecules, which is a milestone unreported so far. Combined with the existing effort to incorporate space symmetries, our approach expands the symmetry toolbox essential for any variational ansatz and brings the ANQS closer to being a competitive choice for studying challenging quantum many-body systems.

arXiv:2310.04166•Oct 6, 2023•4 citations
Neural quantum states (NQSs) have emerged as a powerful ansatz for variational quantum Monte Carlo studies of strongly correlated systems. Here, we apply recurrent neural networks (RNNs) and autoregressive transformer neural networks to the Fermi-Hubbard and the (non-Hermitian) Hatano-Nelson-Hubbard models in one and two dimensions. In both cases, we observe that the convergence of the RNN ansatz is challenged when increasing the interaction strength. We present a physically motivated and easy-to-implement strategy for improving the optimization, namely, by ramping of the model parameters. Furthermore, we investigate the advantages and disadvantages of the autoregressive sampling property of both network architectures. For the Hatano-Nelson-Hubbard model, we identify convergence issues that stem from the autoregressive sampling scheme in combination with the non-Hermitian nature of the model. Our findings provide insights into the challenges of the NQS approach and make the first step towards exploring strongly correlated electrons using this ansatz.
Neural quantum states (NQSs) are powerful variational ansätze capable of representing highly entangled quantum many-body wavefunctions. While the average entanglement properties of ensembles of restricted Boltzmann machines are well understood, the entanglement structure of autoregressive NQSs such as recurrent neural networks and transformers remains largely unexplored. We perform large-scale simulations of ensembles of random autoregressive wavefunctions for chains of up to 256 spins and uncover signatures of transitions in their average entanglement scaling, entanglement spectra, and correlation functions. We show that the standard softmax normalization of the wavefunction suppresses entanglement and fluctuations, and introduce a square modulus normalization function that restores them. Finally, we connect the insights gained from our entanglement and activation function analysis to initialization strategies for finding the ground states of strongly correlated Hamiltonians via variational Monte Carlo.
Accurately determining the ground-state properties of quantum many-body systems remains a central challenge. In this work, we introduce an autoregressive projective quantum Monte Carlo (PQMC) framework that leverages recurrent neural networks (RNNs) to guide the stochastic dynamics. By incorporating autoregressive sampling into PQMC, we demonstrate substantial improvements in accuracy compared to standard unguided PQMC, while retaining polynomial computational cost. We benchmark our approach against conventional variational RNN ansätze and find that the autoregressive PQMC consistently achieves lower energies and higher fidelity, regardless of system size or whether the Hamiltonian is Hermitian or non-Hermitian. Our results highlight the versatility and power of neural-guided PQMC methods, paving the way for promising scalable simulations of low-energy states in complex quantum many-body systems.
Abstract Numerically simulating large, spinful, fermionic systems is of great interest in condensed matter physics. However, the exponential growth of the Hilbert space dimension with system size renders exact quantum state parameterizations impractical. Owing to their representative power, neural networks often allow to overcome this exponential scaling. Here, we investigate the ability of neural quantum states (NQS) to represent the bosonic and fermionict − Jmodel – the high interaction limit of the Hubbard model – on various 1D and 2D lattices. Using autoregressive, tensorized recurrent neural networks (RNNs), we study ground state representations upon hole doping the half-filled system. Additionally, we propose a method to calculate quasiparticle dispersions, applicable to any network architecture or lattice geometry, and allowing to infer the low-energy physics from NQS. By analyzing the strengths and weaknesses of the RNN ansatz we shed light on the challenges and promises of NQS for simulating bosonic and fermionic systems.
Neural-network quantum states have emerged as a powerful variational framework for quantum many-body systems, with recent progress often driven by massively parallel architectures such as transformers. Recurrent neural network quantum states, however, are frequently regarded as intrinsically sequential and therefore less scalable. Here we revisit this view by showing that modern recurrent architectures can support fast, accurate, and computationally accessible neural quantum state simulations. Using autoregressive recurrent wave functions together with recent advances in parallelizable recurrence, we develop variational ansätze, called parallel scan recurrent neural quantum states (PSR-NQS), which can be trained efficiently within variational Monte Carlo in one and two spatial dimensions. We demonstrate accurate benchmark results and show that, with iterative retraining, our approach reaches two-dimensional spin lattices as large as 52×5252\times5252×52 while remaining in agreement with available quantum Monte Carlo data. Our results establish recurrent architectures as a practical and promising route toward scalable neural quantum state simulations with modest computational resources.
Abstract Neural-network quantum states (NQS) are powerful neural-network ansätzes that have emerged as promising tools for studying quantum many-body physics through the lens of the variational principle. These architectures are known to be systematically improvable by increasing the number of parameters. Here we demonstrate an Adaptive scheme to optimize NQSs, through the example of recurrent neural networks (RNNs), using a fraction of the computation cost while reducing training fluctuations and improving the quality of variational calculations targeting ground states of prototypical models in one- and two-spatial dimensions. This Adaptive framework reduces the computational cost through training small RNNs and reusing them to initialize larger RNNs. This work opens up the possibility for optimizing graphical processing unit resources deployed in large-scale NQS simulations.
Neural quantum states have established themselves as a powerful and versatile family of ansatzes for variational Monte Carlo simulations of quantum many-body systems. Of particular prominence are autoregressive neural quantum states (ANQS), which enjoy the expressibility of deep neural networks, and are equipped with a procedure for fast and unbiased sampling. Yet, the non-selective nature of autoregressive sampling makes incorporating quantum number symmetries challenging. In this work, we develop a general framework to make the autoregressive sampling compliant with an arbitrary number of quantum number symmetries. We showcase its advantages by running electronic structure calculations for a range of molecules with multiple symmetries of this kind. We reach the level of accuracy reported in previous works with more than an order of magnitude speedup and achieve chemical accuracy for all studied molecules, which is a milestone unreported so far. Combined with the existing effort to incorporate space symmetries, our approach expands the symmetry toolbox essential for any variational ansatz and brings the ANQS closer to being a competitive choice for studying challenging quantum many-body systems.