This study explores the application of neural network variational Monte Carlo (NN-VMC) for the computation of low-lying excited states in molecular systems. Our focus lies on the implementation and evaluation of two distinct methodologies, the penalty method and a novel modification of the auxiliary wave function (AW) method, within the framework of the FermiNet-based NN-VMC package. Importantly, this specific application has not been previously reported.Our investigation advocates for the efficacy of the modified AW method, emphasizing its superior robustness when compared to the penalty method. This methodological advancement introduces a valuable tool for the scientific community, offering a distinctive approach to target low-lying excited states. We anticipate that the modified AW method will garner interest within the research community, serving as a complementary and robust alternative to existing techniques. Moreover, this contribution enriches the ongoing development of various neural network ansatz, further expanding the toolkit available for the accurate exploration of excited states in molecular systems.
This study explores the application of neural network variational Monte Carlo (NN-VMC) for the computation of low-lying excited states in molecular systems. Our focus lies on the implementation and evaluation of two distinct methodologies, the penalty method and a novel modification of the auxiliary wave function (AW) method, within the framework of the FermiNet-based NN-VMC package. Importantly, this specific application has not been previously reported.Our investigation advocates for the efficacy of the modified AW method, emphasizing its superior robustness when compared to the penalty method. This methodological advancement introduces a valuable tool for the scientific community, offering a distinctive approach to target low-lying excited states. We anticipate that the modified AW method will garner interest within the research community, serving as a complementary and robust alternative to existing techniques. Moreover, this contribution enriches the ongoing development of various neural network ansatz, further expanding the toolkit available for the accurate exploration of excited states in molecular systems.
Describing the electronic structure of molecules using computational methods is of central importance in many areas of chemical research and industry. To this day, the variational quantum Monte Carlo (VMC) algorithm, which utilizes the variational principle of quantum mechanics to optimize an ansatz towards the true electronic wave function, is one of the lesser employed of such computational methods. While it is generally applicable, and provides direct access to the wave function, its accuracy has been limited by insufficiently expressive ansatzes. This barrier was recently lifted with the introduction of deep-learning-based ansatzes, providing unprecedented flexibility and corresponding accuracy, at the cost of increased computational requirements. In this thesis, our implementation of the VMC algorithm with deep-learning ansatzes is described, along with a number of developments facilitating the computation of electronic excited states, extraction of various observables, and characterization of potential energy surfaces, at a reduced computational cost. The method is implemented as open-source software, employing a common framework to encompass most ansatzes present in the literature. Utilizing the direct wave function access granted by VMC, an approach is developed to extract one-electron reduced densities, that are free from Gaussian basis set effects. Significant advances in the methodology of computing electronic excited states via the ladder-of-states approach are made, including an improved form of the overlap penalty term with an automatically determined prefactor, and a new loss term with which the total spin of the solution can be selected. The efficiency of computing excited potential energy surfaces are enhanced by optimizing a single ansatz for a range of molecular configurations. To enable such transferable training in the presence of state crossings, a dynamic, geometry-wise ordering in the ladder of states is introduced. Geometry-optimization-based tasks are identified as natural fits for such transferable ansatzes, and a transferability-native approach for extracting the necessary information from VMC data is devised. Finally, transferable training is employed to simultaneously model different chemical species, resulting in a foundation model predicting bond breaking at a cost-accuracy ratio competitive with mature multi-reference methods. The work presented here contributes significantly to the development of a practically useful deep-learning-based VMC method. The described approaches have the potential to become tools for a wide community of computational chemists, as a source of accurate data, describing strong correlation in both ground and excited states.
We present the first variational Monte Carlo study of nuclear and hypernuclear excited states within the neural-network quantum states (NQS) framework. We implement both the overlap penalty (OP) and natural excited state (NES) methods to compute low-lying excitation spectra. To address the spin contamination in hypernuclear calculations, we propose a quantum number targeting (QNT) technique for the OP method. Both the OP-QNT and NES methods can reproduce diagonal observables, such as energies and spatial structures, in excellent agreement with rigorous benchmarks. We further provide, to our knowledge, the first ab initio calculation of the M 1 transition strength for Λ 4 H . The calculated transition strength is consistent with the weak-coupling limit, exhibiting a ∼ 1.3% suppression. This work demonstrates that NQS can be elevated from ground-state solvers to practical tools for nuclear and hypernuclear spectroscopy.
Diffusion Monte Carlo (DMC) based on fixed-node approximation has enjoyed significant developments in the past decades and become one of the go-to methods when accurate ground state energy of molecules and materials is needed. However, the inaccurate nodal structure hinders the application of DMC for more challenging electronic correlation problems. In this work, we apply the neural-network based trial wavefunction in fixed-node DMC, which allows accurate calculations of a broad range of atomic and molecular systems of different electronic characteristics. Our method is superior in both accuracy and efficiency compared to state-of-the-art neural network methods using variational Monte Carlo (VMC). We also introduce an extrapolation scheme based on the empirical linearity between VMC and DMC energies, and significantly improve our binding energy calculation. Overall, this computational framework provides a benchmark for accurate solutions of correlated electronic wavefunction and also sheds light on the chemical understanding of molecules.
We present an algorithm to estimate the excited states of a quantum system by variational Monte Carlo, which has no free parameters and requires no orthogonalization of the states, instead transforming the problem into that of finding the ground state of an expanded system. Arbitrary observables can be calculated, including off-diagonal expectations, such as the transition dipole moment. The method works particularly well with neural network ansätze, and by combining this method with the FermiNet and Psiformer ansätze, we can accurately recover excitation energies and oscillator strengths on a range of molecules. We achieve accurate vertical excitation energies on benzene-scale molecules, including challenging double excitations. Beyond the examples presented in this work, we expect that this technique will be of interest for atomic, nuclear, and condensed matter physics.
Neural network-based variational Monte Carlo (NN-VMC) has emerged as a promising cutting-edge technique of ab initio quantum chemistry. However, the high computational cost of existing approaches hinders their applications in realistic chemistry problems. Here, we report the development of a new NN-VMC method that achieves a remarkable speed-up by more than one order of magnitude, thereby greatly extending the applicability of NN-VMC to larger systems. Our key design is a novel computational framework named Forward Laplacian, which computes the Laplacian associated with neural networks, the bottleneck of NN-VMC, through an efficient forward propagation process. We then demonstrate that Forward Laplacian is not only versatile but also facilitates more developments of acceleration methods across various aspects, including optimization for sparse derivative matrix and efficient neural network design. Empirically, our approach enables NN-VMC to investigate a broader range of atoms, molecules and chemical reactions for the first time, providing valuable references to other ab initio methods. The results demonstrate a great potential in applying deep learning methods to solve general quantum mechanical problems.
The central challenge in materials science and quantum chemistry is solving the electronic Schrodinger equation, complicated by the curse of dimensionality as system size grows. Neural network-based variational Monte Carlo (NN-VMC) offers a promising path forward, achieving unprecedented accuracy at far lower cost than traditional high-level methods. However, the flexibility of neural network wavefunctions introduces a bottleneck: their optimization is high-dimensional, stochastic, and non-convex. This Perspective reviews the evolution of optimization methods in NN-VMC, from stochastic reconfiguration to approximate second-order algorithms and geometric insights. We highlight key challenges currently limiting scalability and efficiency, and outline future opportunities to advance the field. With continued progress in optimization, neural network techniques, and computer architectures, NN-VMC can tackle larger and more complex quantum systems and move from trailing experiments to guiding them.