Solutions to the Schrodinger equation can be used to predict the electronic structure of molecules and materials and therefore infer their complex physical and chemical properties. Variational Quantum Monte Carlo (VMC) is a technique that can be used to solve the weak form of the Schrodinger equation. Applying VMC to systems with N electrons involves evaluating the determinant of an N by N matrix. The evaluation of this determinant scales as O(N3) and is the main computational cost in the VMC process. In this work, we investigate an alternative VMC technique based on the Vandermonde determinant. The Vandermonde determinant is a product of pairwise differences and so evaluating it scales as O(N2). Therefore, this approach reduces the computational cost by a factor of N. The Vandermonde determinant was implemented in PyTorch and the performance was assessed in approximating the ground state energy of various quantum systems against existing techniques. The performance is evaluated in a variety of systems, starting with the one-dimensional particle in a box, and then considering more complicated atomic systems with multiple particles. The Vandermonde determinant was also implemented in PauliNet, a deep-learning architecture for VMC. The new method is shown to be computationally efficient, and results in a speed-up as large as 5X. In these cases, the new ansatz obtains a reasonable approximation for wavefunctions of atomic systems, but does not reach the accuracy of the Hartree-Fock method that relies on the Slater determinant. It is observed that while the use of neural networks in VMC can result in highly accurate solutions, further work is necessary to determine an appropriate balance between computational time and accuracy.
Solutions to the Schrodinger equation can be used to predict the electronic structure of molecules and materials and therefore infer their complex physical and chemical properties. Variational Quantum Monte Carlo (VMC) is a technique that can be used to solve the weak form of the Schrodinger equation. Applying VMC to systems with N electrons involves evaluating the determinant of an N by N matrix. The evaluation of this determinant scales as O(N3) and is the main computational cost in the VMC process. In this work, we investigate an alternative VMC technique based on the Vandermonde determinant. The Vandermonde determinant is a product of pairwise differences and so evaluating it scales as O(N2). Therefore, this approach reduces the computational cost by a factor of N. The Vandermonde determinant was implemented in PyTorch and the performance was assessed in approximating the ground state energy of various quantum systems against existing techniques. The performance is evaluated in a variety of systems, starting with the one-dimensional particle in a box, and then considering more complicated atomic systems with multiple particles. The Vandermonde determinant was also implemented in PauliNet, a deep-learning architecture for VMC. The new method is shown to be computationally efficient, and results in a speed-up as large as 5X. In these cases, the new ansatz obtains a reasonable approximation for wavefunctions of atomic systems, but does not reach the accuracy of the Hartree-Fock method that relies on the Slater determinant. It is observed that while the use of neural networks in VMC can result in highly accurate solutions, further work is necessary to determine an appropriate balance between computational time and accuracy.
The solution of Schrödinger equation generates the quantisation properties of the system, which can completely describe the quantum behaviour of microscopic particles in a physical system. However, solving the Schrödinger equation is a non-deterministic polynomial time (NP)-hard problem. Numerical methods for solving the Schrödinger equation require careful selection of basis configurations, and the complete basis set has high accuracy but its complexity increases exponentially in the number of particles. Therefore, it is crucial to find an effective numerical method. To solve this problem, this paper present a deep learning architecture, VMCNet, using the powerful computational efficiency of neural networks to improve the speed of numerical computation. Moreover, this paper proposes a suitable wavefunction ansatz, witch determines the accuracy of neural networks, that achieves more accurate energy solutions of the many-electron Schrödinger equation compared to the conventional single-determinant variational molecular Monte Carlo. We introduce non-local and local blocks to represent quantum mechanical interactions, which contain more physical information about the particle system. The experimental results show that VMCNet can cover more than 93% of the correlation energy of the main group elements (Be–Ne) for the monoatomic system and more than 90% of the correlation energy for the diatomic system.
With the ability to solve the many-body Schrödinger equation accurately, in principle all physics and chemistry could be derived from first principles. However, exact wave functions of realistic and interesting systems are in general unavailable because they are non-deterministic polynomial-hard to compute (Troyer, 2005). This implies that we need to rely on approximations. The variational Monte Carlo (VMC) method is widely used for ground state studies, but requires a trial wave function ansatz which must trade off between efficiency and accuracy. The method also has many common features with machine learning algorithms, and as neural networks have shown impressive power as function approximators, the idea is to use a neural network as the trial wave function guess. For fermionic systems, like electronic structure systems, the wave function needs to obey Fermi-Dirac statistics. This is typically achieved using a Slater determinant. As a neural network hardly can model this feature, our approach is to replace the single-particle functions in the Slater determinant with restricted Boltzmann machines, getting the RBM ansatz. In addition, we add further correlations via so-called Jastrow factors (Drummond, 2004). The de facto standard trial wave function ansatz for electronic structure calculations is the Slater-Jastrow ansatz, which was implemented as a reference. Our primary focus is on closed-shell circular quantum dots, where we compute the ground state energy and electron density of two-dimensional systems with up to 90 electrons and three-dimensional systems with up to 70 electrons. The energy obtained by the RBM ansatz was reasonably close to experimental results, and it gradually became closer as we added more complex correlation factors. For our most complicated Jastrow factor, the energy was found to be lower than the energy provided by the Slater-Jastrow ansatz for small dots, but for larger dots it was slightly higher. However, the one-body density profile reveals that the RBM ansatz gives more distinctly located electrons compared to the Slater-Jastrow ansatz. This can be explained by the way the RBM ansatz models the correlations. From the two-body density profile, we also observe that the repulsive interactions get more significant as we add a Jastrow factor. Based on the electron densities and the energy distribution between kinetic and potential energy, it is certain that the various methods provide different electron configurations. For low-frequency dots, the electron density becomes more localized with an additional radial peak compared to high-frequency dots. This is reminiscent of what is known as Wigner localization (Ghosal, 2007). The computational time consumption was found to be favorable for the RBM ansatz for small systems and the Slater-Jastrow ansatz for large systems. This can be explained by the exploding number of variational parameters in the RBM ansatz as the system sizes increase. The RBM ansatz with Jastrow factors were notably more computationally intensive than the other ansätze, and evidently, there is no reason to use the simplest Jastrow factor when more complicated Jastrow factors are available.
Given access to accurate solutions of the many-electron Schrödinger equation, nearly all chemistry could be derived from first principles.Exact wave functions of interesting chemical systems are out of reach because they are NP-hard to compute in general, but approximations can be found using polynomially scaling algorithms.The key challenge for many of these algorithms is the choice of wave function approximation, or Ansatz, which must trade off between efficiency and accuracy.Neural networks have shown impressive power as accurate practical function approximators and promise as a compact wave-function Ansatz for spin systems, but problems in electronic structure require wave functions that obey Fermi-Dirac statistics.Here we introduce a novel deep learning architecture, the Fermionic neural network, as a powerful wave-function Ansatz for many-electron systems.The Fermionic neural network is able to achieve accuracy beyond other variational quantum Monte Carlo Ansatz on a variety of atoms and small molecules.Using no data other than atomic positions and charges, we predict the dissociation curves of the nitrogen molecule and hydrogen chain, two challenging strongly correlated systems, to significantly higher accuracy than the coupled cluster method, widely considered the most accurate scalable method for quantum chemistry at equilibrium geometry.This demonstrates that deep neural networks can improve the accuracy of variational quantum Monte Carlo to the point where it outperforms other ab initio quantum chemistry methods, opening the possibility of accurate direct optimization of wave functions for previously intractable many-electron systems.
The central challenge in materials science and quantum chemistry is solving the electronic Schrodinger equation, complicated by the curse of dimensionality as system size grows. Neural network-based variational Monte Carlo (NN-VMC) offers a promising path forward, achieving unprecedented accuracy at far lower cost than traditional high-level methods. However, the flexibility of neural network wavefunctions introduces a bottleneck: their optimization is high-dimensional, stochastic, and non-convex. This Perspective reviews the evolution of optimization methods in NN-VMC, from stochastic reconfiguration to approximate second-order algorithms and geometric insights. We highlight key challenges currently limiting scalability and efficiency, and outline future opportunities to advance the field. With continued progress in optimization, neural network techniques, and computer architectures, NN-VMC can tackle larger and more complex quantum systems and move from trailing experiments to guiding them.
Describing the electronic structure of molecules using computational methods is of central importance in many areas of chemical research and industry. To this day, the variational quantum Monte Carlo (VMC) algorithm, which utilizes the variational principle of quantum mechanics to optimize an ansatz towards the true electronic wave function, is one of the lesser employed of such computational methods. While it is generally applicable, and provides direct access to the wave function, its accuracy has been limited by insufficiently expressive ansatzes. This barrier was recently lifted with the introduction of deep-learning-based ansatzes, providing unprecedented flexibility and corresponding accuracy, at the cost of increased computational requirements. In this thesis, our implementation of the VMC algorithm with deep-learning ansatzes is described, along with a number of developments facilitating the computation of electronic excited states, extraction of various observables, and characterization of potential energy surfaces, at a reduced computational cost. The method is implemented as open-source software, employing a common framework to encompass most ansatzes present in the literature. Utilizing the direct wave function access granted by VMC, an approach is developed to extract one-electron reduced densities, that are free from Gaussian basis set effects. Significant advances in the methodology of computing electronic excited states via the ladder-of-states approach are made, including an improved form of the overlap penalty term with an automatically determined prefactor, and a new loss term with which the total spin of the solution can be selected. The efficiency of computing excited potential energy surfaces are enhanced by optimizing a single ansatz for a range of molecular configurations. To enable such transferable training in the presence of state crossings, a dynamic, geometry-wise ordering in the ladder of states is introduced. Geometry-optimization-based tasks are identified as natural fits for such transferable ansatzes, and a transferability-native approach for extracting the necessary information from VMC data is devised. Finally, transferable training is employed to simultaneously model different chemical species, resulting in a foundation model predicting bond breaking at a cost-accuracy ratio competitive with mature multi-reference methods. The work presented here contributes significantly to the development of a practically useful deep-learning-based VMC method. The described approaches have the potential to become tools for a wide community of computational chemists, as a source of accurate data, describing strong correlation in both ground and excited states.
Obtaining accurate ground and low-lying excited states of electronic systems is crucial in a multitude of important applications. One ab initio method for solving the Schrödinger equation that scales favorably for large systems is variational quantum Monte Carlo (QMC). The recently introduced deep QMC approach uses ansatzes represented by deep neural networks and generates nearly exact ground-state solutions for molecules containing up to a few dozen electrons, with the potential to scale to much larger systems where other highly accurate methods are not feasible. In this paper, we extend one such ansatz (PauliNet) to compute electronic excited states. We demonstrate our method on various small atoms and molecules and consistently achieve high accuracy for low-lying states. To highlight the method's potential, we compute the first excited state of the much larger benzene molecule, as well as the conical intersection of ethylene, with PauliNet matching results of more expensive high-level methods.