Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

IEEE International Conference on Electronics and Information Technologies (ELIT)

Optimizing Neural Network Wavefunctions Using Variational Monte Carlo with Evolution Strategies

Mykhailo Moroz, O. V. Bovgyra

Published Sep 26, 2023• 0 citations
Publisher

Abstract

Obtaining accurate solutions to many-electron quantum systems is of critical importance, in principle, such solutions allow computing most of possible chemical and physical properties from first principles. Exact solutions require utilizing exponentially scaling algorithms, which are not practical for large systems. Neural networks provide a new approach to approximating the solution while keeping a high level of accuracy. In this work, we explore a novel method of optimizing neural network wavefunctions by employing Evolution Strategies (ES) within a Variational Monte Carlo (VMC) framework. This allows us to more robustly find solutions while keeping a small number of parameters, making it an efficient alternative to traditional methods.

DOI
10.1109/elit61488.2023.10310945

Related papers

Optimization of neural network wave functions in variational Monte Carlo

Yuyang Wang, Xin Liu

The central challenge in materials science and quantum chemistry is solving the electronic Schrodinger equation, complicated by the curse of dimensionality as system size grows. Neural network-based variational Monte Carlo (NN-VMC) offers a promising path forward, achieving unprecedented accuracy at far lower cost than traditional high-level methods. However, the flexibility of neural network wavefunctions introduces a bottleneck: their optimization is high-dimensional, stochastic, and non-convex. This Perspective reviews the evolution of optimization methods in NN-VMC, from stochastic reconfiguration to approximate second-order algorithms and geometric insights. We highlight key challenges currently limiting scalability and efficiency, and outline future opportunities to advance the field. With continued progress in optimization, neural network techniques, and computer architectures, NN-VMC can tackle larger and more complex quantum systems and move from trailing experiments to guiding them.

The Innovation Informatics•Nov 27, 2025•1 citation

A Nonstochastic Optimization Algorithm for Neural-Network Quantum States

Xiang Li, Jia-Cheng Huang, Guang-Ze Zhang +4 more

Neural-network quantum states (NQS) employ artificial neural networks to encode many-body wave functions in a second quantization through variational Monte Carlo (VMC). They have recently been applied to accurately describe electronic wave functions of molecules and have shown the challenges in efficiency compared with traditional quantum chemistry methods. Here, we introduce a general nonstochastic optimization algorithm for NQS in chemical systems, which deterministically generates a selected set of important configurations simultaneously with energy evaluation of NQS. This method bypasses the need for Markov-chain Monte Carlo within the VMC framework, thereby accelerating the entire optimization process. Furthermore, this newly developed nonstochastic optimization algorithm for NQS offers comparable or superior accuracy compared to its stochastic counterpart and ensures more stable convergence. The application of this model to test molecules exhibiting strong electron correlations provides further insight into the performance of NQS in chemical systems and opens avenues for future enhancements.

arXiv:2305.12776•Journal of Chemical Theory and Computation•Nov 14, 2023•16 citations

Ab initio solution of the many-electron Schrödinger equation with deep neural networks

David Pfau, James S. Spencer, Alexander G. D. G. Matthews +1 more

Given access to accurate solutions of the many-electron Schrödinger equation, nearly all chemistry could be derived from first principles.Exact wave functions of interesting chemical systems are out of reach because they are NP-hard to compute in general, but approximations can be found using polynomially scaling algorithms.The key challenge for many of these algorithms is the choice of wave function approximation, or Ansatz, which must trade off between efficiency and accuracy.Neural networks have shown impressive power as accurate practical function approximators and promise as a compact wave-function Ansatz for spin systems, but problems in electronic structure require wave functions that obey Fermi-Dirac statistics.Here we introduce a novel deep learning architecture, the Fermionic neural network, as a powerful wave-function Ansatz for many-electron systems.The Fermionic neural network is able to achieve accuracy beyond other variational quantum Monte Carlo Ansatz on a variety of atoms and small molecules.Using no data other than atomic positions and charges, we predict the dissociation curves of the nitrogen molecule and hydrogen chain, two challenging strongly correlated systems, to significantly higher accuracy than the coupled cluster method, widely considered the most accurate scalable method for quantum chemistry at equilibrium geometry.This demonstrates that deep neural networks can improve the accuracy of variational quantum Monte Carlo to the point where it outperforms other ab initio quantum chemistry methods, opening the possibility of accurate direct optimization of wave functions for previously intractable many-electron systems.

arXiv:1909.02487•Physical Review Research•Sep 16, 2020•552 citations

Variational Quantum Monte Carlo Solution of the Many-Electron Schrödinger Equation Based on Deep Neural Networks

Huiping Su, Hongbo Gao, Xinmiao Wang +2 more

The solution of Schrödinger equation generates the quantisation properties of the system, which can completely describe the quantum behaviour of microscopic particles in a physical system. However, solving the Schrödinger equation is a non-deterministic polynomial time (NP)-hard problem. Numerical methods for solving the Schrödinger equation require careful selection of basis configurations, and the complete basis set has high accuracy but its complexity increases exponentially in the number of particles. Therefore, it is crucial to find an effective numerical method. To solve this problem, this paper present a deep learning architecture, VMCNet, using the powerful computational efficiency of neural networks to improve the speed of numerical computation. Moreover, this paper proposes a suitable wavefunction ansatz, witch determines the accuracy of neural networks, that achieves more accurate energy solutions of the many-electron Schrödinger equation compared to the conventional single-determinant variational molecular Monte Carlo. We introduce non-local and local blocks to represent quantum mechanical interactions, which contain more physical information about the particle system. The experimental results show that VMCNet can cover more than 93% of the correlation energy of the main group elements (Be–Ne) for the monoatomic system and more than 90% of the correlation energy for the diatomic system.

CAAI Artificial Intelligence Research•Feb 1, 2024•1 citation

Transferable neural wavefunctions for solids

Leon Gerard, Michael Scherbela, Halvard Sutterud +2 more

Abstract Deep-learning-based variational Monte Carlo has emerged as a highly accurate method for solving the many-electron Schrödinger equation. Despite favorable scaling with the number of electrons, $${\mathcal{O}}({{n}_{{\rm{el}}}}^{4})$$ O ( n el 4 ) , the practical value of deep-learning-based variational Monte Carlo is limited by the high cost of optimizing the neural network weights for every system studied. Recent research has proposed optimizing a single neural network across multiple systems, reducing the cost per system. Here we extend this approach to solids, which require numerous calculations across different geometries, boundary conditions and supercell sizes. We demonstrate that optimization of a single ansatz across these variations significantly reduces optimization steps. Furthermore, we successfully transfer a network trained on 2 × 2 × 2 supercells of LiH, to 3 × 3 × 3 supercells, reducing the number of optimization steps required to simulate the large system by a factor of 50 compared with previous work.

arXiv:2405.07599•Nature Computational Science•Oct 22, 2025•4 citations

Neural network-based nodal structures optimization for interacting fermionic systems

Freitas, William, B De Abreu, S. A. Vitiello

Simulating strongly correlated fermionic systems remains a fundamental challenge in quantum physics, largely due to the sign problem in quantum Monte Carlo (QMC) methods. We present a neural network-based variational Monte Carlo (NN-VMC) approach, leveraging a flexible neural network ansatz to represent the many-body wavefunction. Focusing on quantum dots with up to 30 electrons, we demonstrate that NN-VMC significantly reduces variational bias and achieves ground-state energies surpassing those of fixed-node diffusion Monte Carlo (DMC). A key feature is that the neural network adaptively learns and optimizes nodal structures during energy minimization. We provide qualitative insights into the nodal structure of fermionic wavefunctions by comparing the nodal structures generated by NN-VMC with those obtained from traditional trial functions. Additionally, we reveal spin-resolved radial distributions and electron density profiles, highlighting the versatility and accuracy of NN-VMC. This work underscores the potential of machine learning to advance quantum simulations and deepen our understanding of strongly correlated systems.

arXiv:2411.02257•Nov 4, 2024•0 citations
Obtaining accurate solutions to many-electron quantum systems is of critical importance, in principle, such solutions allow computing most of possible chemical and physical properties from first principles. Exact solutions require utilizing exponentially scaling algorithms, which are not practical for large systems. Neural networks provide a new approach to approximating the solution while keeping a high level of accuracy. In this work, we explore a novel method of optimizing neural network wavefunctions by employing Evolution Strategies (ES) within a Variational Monte Carlo (VMC) framework. This allows us to more robustly find solutions while keeping a small number of parameters, making it an efficient alternative to traditional methods.
The central challenge in materials science and quantum chemistry is solving the electronic Schrodinger equation, complicated by the curse of dimensionality as system size grows. Neural network-based variational Monte Carlo (NN-VMC) offers a promising path forward, achieving unprecedented accuracy at far lower cost than traditional high-level methods. However, the flexibility of neural network wavefunctions introduces a bottleneck: their optimization is high-dimensional, stochastic, and non-convex. This Perspective reviews the evolution of optimization methods in NN-VMC, from stochastic reconfiguration to approximate second-order algorithms and geometric insights. We highlight key challenges currently limiting scalability and efficiency, and outline future opportunities to advance the field. With continued progress in optimization, neural network techniques, and computer architectures, NN-VMC can tackle larger and more complex quantum systems and move from trailing experiments to guiding them.
Neural-network quantum states (NQS) employ artificial neural networks to encode many-body wave functions in a second quantization through variational Monte Carlo (VMC). They have recently been applied to accurately describe electronic wave functions of molecules and have shown the challenges in efficiency compared with traditional quantum chemistry methods. Here, we introduce a general nonstochastic optimization algorithm for NQS in chemical systems, which deterministically generates a selected set of important configurations simultaneously with energy evaluation of NQS. This method bypasses the need for Markov-chain Monte Carlo within the VMC framework, thereby accelerating the entire optimization process. Furthermore, this newly developed nonstochastic optimization algorithm for NQS offers comparable or superior accuracy compared to its stochastic counterpart and ensures more stable convergence. The application of this model to test molecules exhibiting strong electron correlations provides further insight into the performance of NQS in chemical systems and opens avenues for future enhancements.
Given access to accurate solutions of the many-electron Schrödinger equation, nearly all chemistry could be derived from first principles.Exact wave functions of interesting chemical systems are out of reach because they are NP-hard to compute in general, but approximations can be found using polynomially scaling algorithms.The key challenge for many of these algorithms is the choice of wave function approximation, or Ansatz, which must trade off between efficiency and accuracy.Neural networks have shown impressive power as accurate practical function approximators and promise as a compact wave-function Ansatz for spin systems, but problems in electronic structure require wave functions that obey Fermi-Dirac statistics.Here we introduce a novel deep learning architecture, the Fermionic neural network, as a powerful wave-function Ansatz for many-electron systems.The Fermionic neural network is able to achieve accuracy beyond other variational quantum Monte Carlo Ansatz on a variety of atoms and small molecules.Using no data other than atomic positions and charges, we predict the dissociation curves of the nitrogen molecule and hydrogen chain, two challenging strongly correlated systems, to significantly higher accuracy than the coupled cluster method, widely considered the most accurate scalable method for quantum chemistry at equilibrium geometry.This demonstrates that deep neural networks can improve the accuracy of variational quantum Monte Carlo to the point where it outperforms other ab initio quantum chemistry methods, opening the possibility of accurate direct optimization of wave functions for previously intractable many-electron systems.
The solution of Schrödinger equation generates the quantisation properties of the system, which can completely describe the quantum behaviour of microscopic particles in a physical system. However, solving the Schrödinger equation is a non-deterministic polynomial time (NP)-hard problem. Numerical methods for solving the Schrödinger equation require careful selection of basis configurations, and the complete basis set has high accuracy but its complexity increases exponentially in the number of particles. Therefore, it is crucial to find an effective numerical method. To solve this problem, this paper present a deep learning architecture, VMCNet, using the powerful computational efficiency of neural networks to improve the speed of numerical computation. Moreover, this paper proposes a suitable wavefunction ansatz, witch determines the accuracy of neural networks, that achieves more accurate energy solutions of the many-electron Schrödinger equation compared to the conventional single-determinant variational molecular Monte Carlo. We introduce non-local and local blocks to represent quantum mechanical interactions, which contain more physical information about the particle system. The experimental results show that VMCNet can cover more than 93% of the correlation energy of the main group elements (Be–Ne) for the monoatomic system and more than 90% of the correlation energy for the diatomic system.
Abstract Deep-learning-based variational Monte Carlo has emerged as a highly accurate method for solving the many-electron Schrödinger equation. Despite favorable scaling with the number of electrons, O(nel4){\mathcal{O}}({{n}_{{\rm{el}}}}^{4})O(nel​4) O ( n el 4 ) , the practical value of deep-learning-based variational Monte Carlo is limited by the high cost of optimizing the neural network weights for every system studied. Recent research has proposed optimizing a single neural network across multiple systems, reducing the cost per system. Here we extend this approach to solids, which require numerous calculations across different geometries, boundary conditions and supercell sizes. We demonstrate that optimization of a single ansatz across these variations significantly reduces optimization steps. Furthermore, we successfully transfer a network trained on 2 × 2 × 2 supercells of LiH, to 3 × 3 × 3 supercells, reducing the number of optimization steps required to simulate the large system by a factor of 50 compared with previous work.
Simulating strongly correlated fermionic systems remains a fundamental challenge in quantum physics, largely due to the sign problem in quantum Monte Carlo (QMC) methods. We present a neural network-based variational Monte Carlo (NN-VMC) approach, leveraging a flexible neural network ansatz to represent the many-body wavefunction. Focusing on quantum dots with up to 30 electrons, we demonstrate that NN-VMC significantly reduces variational bias and achieves ground-state energies surpassing those of fixed-node diffusion Monte Carlo (DMC). A key feature is that the neural network adaptively learns and optimizes nodal structures during energy minimization. We provide qualitative insights into the nodal structure of fermionic wavefunctions by comparing the nodal structures generated by NN-VMC with those obtained from traditional trial functions. Additionally, we reveal spin-resolved radial distributions and electron density profiles, highlighting the versatility and accuracy of NN-VMC. This work underscores the potential of machine learning to advance quantum simulations and deepen our understanding of strongly correlated systems.