Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2409.01306 · The Journal of Chemical Physics

Highly accurate real-space electron densities with neural networks

Lixue Cheng, P. Bernát Szabó, Zeno Schätzle, Derk Pieter Kooi, Jonas Köhler, Klaas J. H. Giesbertz, Frank Noé, Jan Hermann, Paola Gori‐Giorgi, Adam Foster

Published Jan 21, 2025• 11 citations
arXivHTMLPDF

Abstract

Variational ab initio methods in quantum chemistry stand out among other methods in providing direct access to the wave function. This allows, in principle, straightforward extraction of any other observable of interest, besides the energy, but, in practice, this extraction is often technically difficult and computationally impractical. Here, we consider the electron density as a central observable in quantum chemistry and introduce a novel method to obtain accurate densities from real-space many-electron wave functions by representing the density with a neural network that captures known asymptotic properties and is trained from the wave function by score matching and noise-contrastive estimation. We use variational quantum Monte Carlo with deep-learning Ansätze to obtain highly accurate wave functions free of basis set errors and from them, using our novel method, correspondingly accurate electron densities, which we demonstrate by calculating dipole moments, nuclear forces, contact densities, and other density-based properties.

DOI
10.1063/5.0236919

Related papers

Ab initio solution of the many-electron Schrödinger equation with deep neural networks

David Pfau, James S. Spencer, Alexander G. D. G. Matthews +1 more

Given access to accurate solutions of the many-electron Schrödinger equation, nearly all chemistry could be derived from first principles.Exact wave functions of interesting chemical systems are out of reach because they are NP-hard to compute in general, but approximations can be found using polynomially scaling algorithms.The key challenge for many of these algorithms is the choice of wave function approximation, or Ansatz, which must trade off between efficiency and accuracy.Neural networks have shown impressive power as accurate practical function approximators and promise as a compact wave-function Ansatz for spin systems, but problems in electronic structure require wave functions that obey Fermi-Dirac statistics.Here we introduce a novel deep learning architecture, the Fermionic neural network, as a powerful wave-function Ansatz for many-electron systems.The Fermionic neural network is able to achieve accuracy beyond other variational quantum Monte Carlo Ansatz on a variety of atoms and small molecules.Using no data other than atomic positions and charges, we predict the dissociation curves of the nitrogen molecule and hydrogen chain, two challenging strongly correlated systems, to significantly higher accuracy than the coupled cluster method, widely considered the most accurate scalable method for quantum chemistry at equilibrium geometry.This demonstrates that deep neural networks can improve the accuracy of variational quantum Monte Carlo to the point where it outperforms other ab initio quantum chemistry methods, opening the possibility of accurate direct optimization of wave functions for previously intractable many-electron systems.

arXiv:1909.02487•Physical Review Research•Sep 16, 2020•552 citations

Deep quantum Monte Carlo approach for polaritonic chemistry

Yifan Tang, Gian Marcello Andolina, Alice Cuzzocrea +5 more

Recent years have witnessed a surge of experimental and theoretical interest in controlling the properties of matter, such as its chemical reactivity, by confining it in optical cavities, where the enhancement of the light-matter coupling strength leads to the creation of hybrid light-matter states known as polaritons. However, ab initio calculations that account for the quantum nature of both the electromagnetic field and matter are challenging and have only started to be developed in recent years. We introduce a deep learning variational quantum Monte Carlo method to solve the electronic and photonic Schrödinger equations of molecules trapped in optical cavities. We extend typical electronic neural network wave function ansätze to describe joint fermionic and bosonic systems, i.e., electron-photon systems, in a quantum Monte Carlo framework. We apply our method to hydrogen molecules in a cavity, computing both ground and excited states. We assess their energy, dipole moment, charge density shift due to the cavity, the state of the photonic field, and the entanglement developed between the electrons and photons. Where possible, we compare our results with more conventional quantum chemistry methods proposed in the literature, finding good qualitative agreement, thus extending the range of scientific problems that can be tackled using machine learning techniques.

arXiv:2503.15644•The Journal of Chemical Physics•Jul 15, 2025•4 citations

Interatomic force from neural network based variational quantum Monte Carlo

Yubing Qian, Weizhong Fu, Weiluo Ren +1 more

Accurate ab initio calculations are of fundamental importance in physics, chemistry, biology, and materials science, which have witnessed rapid development in the last couple of years with the help of machine learning computational techniques such as neural networks. Most of the recent efforts applying neural networks to ab initio calculation have been focusing on the energy of the system. In this study, we take a step forward and look at the interatomic force obtained with neural network wavefunction methods by implementing and testing several commonly used force estimators in variational quantum Monte Carlo (VMC). Our results show that neural network ansatz can improve the calculation of interatomic force upon traditional VMC. The relationship between the force error and the quality of the neural network, the contribution of different force terms, and the computational cost of each term is also discussed to provide guidelines for future applications. Our work demonstrates that it is promising to apply neural network wavefunction methods in simulating structures/dynamics of molecules/materials and provide training data for developing accurate force fields.

arXiv:2207.07810•The Journal of Chemical Physics•Oct 5, 2022•20 citations

DeepQMC: An open-source software suite for variational optimization of deep-learning molecular wave functions

Zeno Schätzle, P. Bernát Szabó, Matěj Mezera +2 more

Computing accurate yet efficient approximations to the solutions of the electronic Schrödinger equation has been a paramount challenge of computational chemistry for decades. Quantum Monte Carlo methods are a promising avenue of development as their core algorithm exhibits a number of favorable properties: it is highly parallel and scales favorably with the considered system size, with an accuracy that is limited only by the choice of the wave function Ansatz. The recently introduced machine-learned parametrizations of quantum Monte Carlo Ansätze rely on the efficiency of neural networks as universal function approximators to achieve state of the art accuracy on a variety of molecular systems. With interest in the field growing rapidly, there is a clear need for easy to use, modular, and extendable software libraries facilitating the development and adoption of this new class of methods. In this contribution, the DeepQMC program package is introduced, in an attempt to provide a common framework for future investigations by unifying many of the currently available deep-learning quantum Monte Carlo architectures. Furthermore, the manuscript provides a brief introduction to the methodology of variational quantum Monte Carlo in real space, highlights some technical challenges of optimizing neural network wave functions, and presents example black-box applications of the program package. We thereby intend to make this novel field accessible to a broader class of practitioners from both the quantum chemistry and the machine learning communities.

The Journal of Chemical Physics•Sep 6, 2023•25 citations

DeepQMC: An open-source software suite for variational optimization of deep-learning molecular wave functions

Zeno Schätzle, P. Bernát Szabó, Matěj Mezera +2 more

Computing accurate yet efficient approximations to the solutions of the electronic Schrödinger equation has been a paramount challenge of computational chemistry for decades. Quantum Monte Carlo methods are a promising avenue of development as their core algorithm exhibits a number of favorable properties: it is highly parallel and scales favorably with the considered system size, with an accuracy that is limited only by the choice of the wave function Ansatz. The recently introduced machine-learned parametrizations of quantum Monte Carlo Ansätze rely on the efficiency of neural networks as universal function approximators to achieve state of the art accuracy on a variety of molecular systems. With interest in the field growing rapidly, there is a clear need for easy to use, modular, and extendable software libraries facilitating the development and adoption of this new class of methods. In this contribution, the DeepQMC program package is introduced, in an attempt to provide a common framework for future investigations by unifying many of the currently available deep-learning quantum Monte Carlo architectures. Furthermore, the manuscript provides a brief introduction to the methodology of variational quantum Monte Carlo in real space, highlights some technical challenges of optimizing neural network wave functions, and presents example black-box applications of the program package. We thereby intend to make this novel field accessible to a broader class of practitioners from both the quantum chemistry and the machine learning communities.

arXiv:2307.14123•Jan 1, 2023•0 citations

Variance extrapolation method for neural-network variational Monte Carlo

Weizhong Fu, Weiluo Ren, Ji Chen

Abstract Constructing more expressive ansatz has been a primary focus for quantum Monte Carlo, aimed at more accurate ab initio calculations. However, with more powerful ansatz, e.g. various recent developed models based on neural-network architectures, the training becomes more difficult and expensive, which may have a counterproductive effect on the accuracy of calculation. In this work, we propose to make use of the training data to perform empirical variance extrapolation when using neural-network ansatz in variational Monte Carlo. We show that this approach can speed up the convergence and surpass the ansatz limitation to obtain an improved estimation of the energy. Moreover, variance extrapolation greatly enhances the error cancellation capability, resulting in significantly improved relative energy outcomes, which are the keys to chemistry and physics problems.

arXiv:2308.02471•Machine Learning Science and Technology•Jan 17, 2024•10 citations
Variational ab initio methods in quantum chemistry stand out among other methods in providing direct access to the wave function. This allows, in principle, straightforward extraction of any other observable of interest, besides the energy, but, in practice, this extraction is often technically difficult and computationally impractical. Here, we consider the electron density as a central observable in quantum chemistry and introduce a novel method to obtain accurate densities from real-space many-electron wave functions by representing the density with a neural network that captures known asymptotic properties and is trained from the wave function by score matching and noise-contrastive estimation. We use variational quantum Monte Carlo with deep-learning Ansätze to obtain highly accurate wave functions free of basis set errors and from them, using our novel method, correspondingly accurate electron densities, which we demonstrate by calculating dipole moments, nuclear forces, contact densities, and other density-based properties.
Given access to accurate solutions of the many-electron Schrödinger equation, nearly all chemistry could be derived from first principles.Exact wave functions of interesting chemical systems are out of reach because they are NP-hard to compute in general, but approximations can be found using polynomially scaling algorithms.The key challenge for many of these algorithms is the choice of wave function approximation, or Ansatz, which must trade off between efficiency and accuracy.Neural networks have shown impressive power as accurate practical function approximators and promise as a compact wave-function Ansatz for spin systems, but problems in electronic structure require wave functions that obey Fermi-Dirac statistics.Here we introduce a novel deep learning architecture, the Fermionic neural network, as a powerful wave-function Ansatz for many-electron systems.The Fermionic neural network is able to achieve accuracy beyond other variational quantum Monte Carlo Ansatz on a variety of atoms and small molecules.Using no data other than atomic positions and charges, we predict the dissociation curves of the nitrogen molecule and hydrogen chain, two challenging strongly correlated systems, to significantly higher accuracy than the coupled cluster method, widely considered the most accurate scalable method for quantum chemistry at equilibrium geometry.This demonstrates that deep neural networks can improve the accuracy of variational quantum Monte Carlo to the point where it outperforms other ab initio quantum chemistry methods, opening the possibility of accurate direct optimization of wave functions for previously intractable many-electron systems.
Recent years have witnessed a surge of experimental and theoretical interest in controlling the properties of matter, such as its chemical reactivity, by confining it in optical cavities, where the enhancement of the light-matter coupling strength leads to the creation of hybrid light-matter states known as polaritons. However, ab initio calculations that account for the quantum nature of both the electromagnetic field and matter are challenging and have only started to be developed in recent years. We introduce a deep learning variational quantum Monte Carlo method to solve the electronic and photonic Schrödinger equations of molecules trapped in optical cavities. We extend typical electronic neural network wave function ansätze to describe joint fermionic and bosonic systems, i.e., electron-photon systems, in a quantum Monte Carlo framework. We apply our method to hydrogen molecules in a cavity, computing both ground and excited states. We assess their energy, dipole moment, charge density shift due to the cavity, the state of the photonic field, and the entanglement developed between the electrons and photons. Where possible, we compare our results with more conventional quantum chemistry methods proposed in the literature, finding good qualitative agreement, thus extending the range of scientific problems that can be tackled using machine learning techniques.
Accurate ab initio calculations are of fundamental importance in physics, chemistry, biology, and materials science, which have witnessed rapid development in the last couple of years with the help of machine learning computational techniques such as neural networks. Most of the recent efforts applying neural networks to ab initio calculation have been focusing on the energy of the system. In this study, we take a step forward and look at the interatomic force obtained with neural network wavefunction methods by implementing and testing several commonly used force estimators in variational quantum Monte Carlo (VMC). Our results show that neural network ansatz can improve the calculation of interatomic force upon traditional VMC. The relationship between the force error and the quality of the neural network, the contribution of different force terms, and the computational cost of each term is also discussed to provide guidelines for future applications. Our work demonstrates that it is promising to apply neural network wavefunction methods in simulating structures/dynamics of molecules/materials and provide training data for developing accurate force fields.
Computing accurate yet efficient approximations to the solutions of the electronic Schrödinger equation has been a paramount challenge of computational chemistry for decades. Quantum Monte Carlo methods are a promising avenue of development as their core algorithm exhibits a number of favorable properties: it is highly parallel and scales favorably with the considered system size, with an accuracy that is limited only by the choice of the wave function Ansatz. The recently introduced machine-learned parametrizations of quantum Monte Carlo Ansätze rely on the efficiency of neural networks as universal function approximators to achieve state of the art accuracy on a variety of molecular systems. With interest in the field growing rapidly, there is a clear need for easy to use, modular, and extendable software libraries facilitating the development and adoption of this new class of methods. In this contribution, the DeepQMC program package is introduced, in an attempt to provide a common framework for future investigations by unifying many of the currently available deep-learning quantum Monte Carlo architectures. Furthermore, the manuscript provides a brief introduction to the methodology of variational quantum Monte Carlo in real space, highlights some technical challenges of optimizing neural network wave functions, and presents example black-box applications of the program package. We thereby intend to make this novel field accessible to a broader class of practitioners from both the quantum chemistry and the machine learning communities.
Computing accurate yet efficient approximations to the solutions of the electronic Schrödinger equation has been a paramount challenge of computational chemistry for decades. Quantum Monte Carlo methods are a promising avenue of development as their core algorithm exhibits a number of favorable properties: it is highly parallel and scales favorably with the considered system size, with an accuracy that is limited only by the choice of the wave function Ansatz. The recently introduced machine-learned parametrizations of quantum Monte Carlo Ansätze rely on the efficiency of neural networks as universal function approximators to achieve state of the art accuracy on a variety of molecular systems. With interest in the field growing rapidly, there is a clear need for easy to use, modular, and extendable software libraries facilitating the development and adoption of this new class of methods. In this contribution, the DeepQMC program package is introduced, in an attempt to provide a common framework for future investigations by unifying many of the currently available deep-learning quantum Monte Carlo architectures. Furthermore, the manuscript provides a brief introduction to the methodology of variational quantum Monte Carlo in real space, highlights some technical challenges of optimizing neural network wave functions, and presents example black-box applications of the program package. We thereby intend to make this novel field accessible to a broader class of practitioners from both the quantum chemistry and the machine learning communities.
Abstract Constructing more expressive ansatz has been a primary focus for quantum Monte Carlo, aimed at more accurate ab initio calculations. However, with more powerful ansatz, e.g. various recent developed models based on neural-network architectures, the training becomes more difficult and expensive, which may have a counterproductive effect on the accuracy of calculation. In this work, we propose to make use of the training data to perform empirical variance extrapolation when using neural-network ansatz in variational Monte Carlo. We show that this approach can speed up the convergence and surpass the ansatz limitation to obtain an improved estimation of the energy. Moreover, variance extrapolation greatly enhances the error cancellation capability, resulting in significantly improved relative energy outcomes, which are the keys to chemistry and physics problems.