Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2604.15888

Enhancing Neural-Network Variational Monte Carlo through Basis Transformation

Zhixuan Liu, Dongheng Qian, Jing Wang

cond-mat.str-elcond-mat.dis-nnphysics.comp-phquant-phSubmitted Apr 17, 2026• Announced Apr 20, 2026• 0 citations
v1 · Apr 17, 2026v2 · Jun 3, 2026
arXivHTMLPDF

Abstract

Neural-network variational Monte Carlo (NNVMC) has emerged as a powerful tool for solving quantum many-body problems, yet systematic pathways for improving its accuracy remain largely heuristic. Here, we introduce a physically motivated basis transformation for NNVMC that enhances variational expressivity without increasing the complexity of the neural-network ansatz itself. By formulating the many-body wave function in a Gaussian basis, we introduce a single learnable locality parameter, $α$, that reshapes the target ground state into a more learnable representation. This approach introduces minimal computational overhead and can be readily combined with existing neural-network architectures. Using the three-dimensional homogeneous electron gas as a benchmark, we show that the optimized basis transformation consistently lowers the variational energy for both FermiNet and message-passing neural-network architectures. Notably, for the latter, it enables a more precise determination of the Fermi liquid to Wigner crystal phase transition. More broadly, our results highlight basis transformation as a new route to improving NNVMC in continuous space, showing that accuracy can be enhanced not only by refining the ansatz but also by making the target ground state easier to represent.

Comments
7 pages, 4 figures

Related papers

Enhancing the Expressivity of Variational Neural, and Hardware-Efficient Quantum States Through Orbital Rotations

Javier Robledo Moreno, Jeffrey F. Cohn, Dries Sels +1 more

Variational approaches, such as variational Monte Carlo (VMC) or the variational quantum eigensolver (VQE), are powerful techniques to tackle the ground-state many-electron problem. Often, the family of variational states is not invariant under the reparametrization of the Hamiltonian by single-particle basis transformations. As a consequence, the representability of the ground-state wave function by the variational ansatz strongly dependents on the choice of the single-particle basis. In this manuscript we study the joint optimization of the single-particle basis, together with the variational state in the VMC (with neural quantum states) and VQE (with hardware-efficient circuits) approaches. We show that the joint optimization of the single-particle basis with the variational state parameters yields significant improvements in the expressive power and optimization landscape in a variety of chemistry and condensed matter systems. We also realize the first active-space calculation using neural quantum states, where the single-particle basis transformations are applied to all of the orbitals in the basis set.

arXiv:2302.11588•Feb 22, 2023•4 citations

A Survey of Neural Network Variational Monte Carlo from a Computing Workload Characterization Perspective

Zhengze Xiao, Xuanzhe Ding, Yuyang Lou +2 more

Neural Network Variational Monte Carlo (NNVMC) has emerged as a promising paradigm for solving quantum many-body problems by combining variational Monte Carlo with expressive neural-network wave-function ansätze. Although NNVMC can achieve competitive accuracy with favorable asymptotic scaling, practical deployment remains limited by high runtime and memory cost on modern graphics processing units (GPUs). Compared with language and vision workloads, NNVMC execution is shaped by physics-specific stages, including Markov-Chain Monte Carlo sampling, wave-function construction, and derivative/Laplacian evaluation, which produce heterogeneous kernel behavior and nontrivial bottlenecks. This paper provides a workload-oriented survey and empirical GPU characterization of four representative ansätze: PauliNet, FermiNet, Psiformer, and Orbformer. Using a unified profiling protocol, we analyze model-level runtime and memory trends and kernel-level behavior through family breakdown, arithmetic intensity, roofline positioning, and hardware utilization counters. The results show that end-to-end performance is often constrained by low-intensity elementwise and data-movement kernels, while the compute/memory balance varies substantially across ansätze and stages. Based on these findings, we discuss algorithm--hardware co-design implications for scalable NNVMC systems, including phase-aware scheduling, memory-centric optimization, and heterogeneous acceleration.

arXiv:2603.18126•Mar 18, 2026•0 citations

Message-passing neural quantum states for the homogeneous electron gas

Gabriel Pescia, Jannes Nys, Jane Kim +2 more

The immense parameter complexity of current neural-network quantum states (NQS) in continuous space renders their application to realistic physical systems impossible. Here, the authors rigorously motivate a many-body coordinate transformation as basis for a variational neural-network Ansatz, implement it via message-passing neural networks, and show a resulting reduction of two orders of magnitude in parameter complexity and convergence speed. With this, the authors open the door for future NQS studies of extended systems in the thermodynamic limit.

arXiv:2305.07240•Physical review. B./Physical review. B•Jul 2, 2024•52 citations

Looking elsewhere: improving variational Monte Carlo gradients by importance sampling

Antoine Misery, Luca Gravina, Alessandro Santini +1 more

Abstract Neural-network quantum states (NQSs) offer a powerful and expressive ansatz for representing quantum many-body wave functions. However, their training via Variational Monte Carlo (VMC) methods remains challenging. It is well known that some scenarios—such as sharply peaked wave functions emerging in quantum chemistry—lead to high-variance gradient estimators hindering the effectiveness of variational optimizations. In this work we investigate a systematic strategy to tackle those sampling issues by means of adaptively tuned importance sampling. Our approach is explicitly designed to target the gradient estimator instead of the loss function, and be computationally inexpensive. We benchmarked our approach across the ground-state search of a wide variety of hamiltonians, including frustrated spin systems and ab-initio quantum chemistry. Overall, our approach can reduce the computational cost of vanilla VMC considerably, up to a factor of 100× when targeting highly peaked quantum chemistry wavefunctions.

arXiv:2507.05352•Machine Learning Science and Technology•Jan 14, 2026•2 citations

Discovering Quantum Phase Transitions with Fermionic Neural Networks

Gino Cassella, Halvard Sutterud, Sam Azadi +4 more

Deep neural networks have been very successful as highly accurate wave function Ansätze for variational Monte Carlo calculations of molecular ground states. We present an extension of one such Ansatz, FermiNet, to calculations of the ground states of periodic Hamiltonians, and study the homogeneous electron gas. FermiNet calculations of the ground-state energies of small electron gas systems are in excellent agreement with previous initiator full configuration interaction quantum Monte Carlo and diffusion Monte Carlo calculations. We investigate the spin-polarized homogeneous electron gas and demonstrate that the same neural network architecture is capable of accurately representing both the delocalized Fermi liquid state and the localized Wigner crystal state. The network converges on the translationally invariant ground state at high density and spontaneously breaks the symmetry to produce the crystalline ground state at low density, despite being given no a priori knowledge that a phase transition exists.

arXiv:2202.05183•Physical Review Letters•Jan 20, 2023•79 citations

Neural network-based nodal structures optimization for interacting fermionic systems

Freitas, William, B De Abreu, S. A. Vitiello

Simulating strongly correlated fermionic systems remains a fundamental challenge in quantum physics, largely due to the sign problem in quantum Monte Carlo (QMC) methods. We present a neural network-based variational Monte Carlo (NN-VMC) approach, leveraging a flexible neural network ansatz to represent the many-body wavefunction. Focusing on quantum dots with up to 30 electrons, we demonstrate that NN-VMC significantly reduces variational bias and achieves ground-state energies surpassing those of fixed-node diffusion Monte Carlo (DMC). A key feature is that the neural network adaptively learns and optimizes nodal structures during energy minimization. We provide qualitative insights into the nodal structure of fermionic wavefunctions by comparing the nodal structures generated by NN-VMC with those obtained from traditional trial functions. Additionally, we reveal spin-resolved radial distributions and electron density profiles, highlighting the versatility and accuracy of NN-VMC. This work underscores the potential of machine learning to advance quantum simulations and deepen our understanding of strongly correlated systems.

arXiv:2411.02257•Nov 4, 2024•0 citations
Neural-network variational Monte Carlo (NNVMC) has emerged as a powerful tool for solving quantum many-body problems, yet systematic pathways for improving its accuracy remain largely heuristic. Here, we introduce a physically motivated basis transformation for NNVMC that enhances variational expressivity without increasing the complexity of the neural-network ansatz itself. By formulating the many-body wave function in a Gaussian basis, we introduce a single learnable locality parameter, ααα, that reshapes the target ground state into a more learnable representation. This approach introduces minimal computational overhead and can be readily combined with existing neural-network architectures. Using the three-dimensional homogeneous electron gas as a benchmark, we show that the optimized basis transformation consistently lowers the variational energy for both FermiNet and message-passing neural-network architectures. Notably, for the latter, it enables a more precise determination of the Fermi liquid to Wigner crystal phase transition. More broadly, our results highlight basis transformation as a new route to improving NNVMC in continuous space, showing that accuracy can be enhanced not only by refining the ansatz but also by making the target ground state easier to represent.
Variational approaches, such as variational Monte Carlo (VMC) or the variational quantum eigensolver (VQE), are powerful techniques to tackle the ground-state many-electron problem. Often, the family of variational states is not invariant under the reparametrization of the Hamiltonian by single-particle basis transformations. As a consequence, the representability of the ground-state wave function by the variational ansatz strongly dependents on the choice of the single-particle basis. In this manuscript we study the joint optimization of the single-particle basis, together with the variational state in the VMC (with neural quantum states) and VQE (with hardware-efficient circuits) approaches. We show that the joint optimization of the single-particle basis with the variational state parameters yields significant improvements in the expressive power and optimization landscape in a variety of chemistry and condensed matter systems. We also realize the first active-space calculation using neural quantum states, where the single-particle basis transformations are applied to all of the orbitals in the basis set.
Neural Network Variational Monte Carlo (NNVMC) has emerged as a promising paradigm for solving quantum many-body problems by combining variational Monte Carlo with expressive neural-network wave-function ansätze. Although NNVMC can achieve competitive accuracy with favorable asymptotic scaling, practical deployment remains limited by high runtime and memory cost on modern graphics processing units (GPUs). Compared with language and vision workloads, NNVMC execution is shaped by physics-specific stages, including Markov-Chain Monte Carlo sampling, wave-function construction, and derivative/Laplacian evaluation, which produce heterogeneous kernel behavior and nontrivial bottlenecks. This paper provides a workload-oriented survey and empirical GPU characterization of four representative ansätze: PauliNet, FermiNet, Psiformer, and Orbformer. Using a unified profiling protocol, we analyze model-level runtime and memory trends and kernel-level behavior through family breakdown, arithmetic intensity, roofline positioning, and hardware utilization counters. The results show that end-to-end performance is often constrained by low-intensity elementwise and data-movement kernels, while the compute/memory balance varies substantially across ansätze and stages. Based on these findings, we discuss algorithm--hardware co-design implications for scalable NNVMC systems, including phase-aware scheduling, memory-centric optimization, and heterogeneous acceleration.
The immense parameter complexity of current neural-network quantum states (NQS) in continuous space renders their application to realistic physical systems impossible. Here, the authors rigorously motivate a many-body coordinate transformation as basis for a variational neural-network Ansatz, implement it via message-passing neural networks, and show a resulting reduction of two orders of magnitude in parameter complexity and convergence speed. With this, the authors open the door for future NQS studies of extended systems in the thermodynamic limit.
Abstract Neural-network quantum states (NQSs) offer a powerful and expressive ansatz for representing quantum many-body wave functions. However, their training via Variational Monte Carlo (VMC) methods remains challenging. It is well known that some scenarios—such as sharply peaked wave functions emerging in quantum chemistry—lead to high-variance gradient estimators hindering the effectiveness of variational optimizations. In this work we investigate a systematic strategy to tackle those sampling issues by means of adaptively tuned importance sampling. Our approach is explicitly designed to target the gradient estimator instead of the loss function, and be computationally inexpensive. We benchmarked our approach across the ground-state search of a wide variety of hamiltonians, including frustrated spin systems and ab-initio quantum chemistry. Overall, our approach can reduce the computational cost of vanilla VMC considerably, up to a factor of 100× when targeting highly peaked quantum chemistry wavefunctions.
Deep neural networks have been very successful as highly accurate wave function Ansätze for variational Monte Carlo calculations of molecular ground states. We present an extension of one such Ansatz, FermiNet, to calculations of the ground states of periodic Hamiltonians, and study the homogeneous electron gas. FermiNet calculations of the ground-state energies of small electron gas systems are in excellent agreement with previous initiator full configuration interaction quantum Monte Carlo and diffusion Monte Carlo calculations. We investigate the spin-polarized homogeneous electron gas and demonstrate that the same neural network architecture is capable of accurately representing both the delocalized Fermi liquid state and the localized Wigner crystal state. The network converges on the translationally invariant ground state at high density and spontaneously breaks the symmetry to produce the crystalline ground state at low density, despite being given no a priori knowledge that a phase transition exists.
Simulating strongly correlated fermionic systems remains a fundamental challenge in quantum physics, largely due to the sign problem in quantum Monte Carlo (QMC) methods. We present a neural network-based variational Monte Carlo (NN-VMC) approach, leveraging a flexible neural network ansatz to represent the many-body wavefunction. Focusing on quantum dots with up to 30 electrons, we demonstrate that NN-VMC significantly reduces variational bias and achieves ground-state energies surpassing those of fixed-node diffusion Monte Carlo (DMC). A key feature is that the neural network adaptively learns and optimizes nodal structures during energy minimization. We provide qualitative insights into the nodal structure of fermionic wavefunctions by comparing the nodal structures generated by NN-VMC with those obtained from traditional trial functions. Additionally, we reveal spin-resolved radial distributions and electron density profiles, highlighting the versatility and accuracy of NN-VMC. This work underscores the potential of machine learning to advance quantum simulations and deepen our understanding of strongly correlated systems.