The Journal of Chemical Physics

Toward a systematic improvement of the fixed-node approximation in diffusion Monte Carlo for solids—A case study in diamond

Anouar Benali, Kevin E. Gasperich, Kenneth D. Jordan, Thomas Applencourt, Ye Luo, M. Chandler Bennett, Jaron T. Krogel, Luke Shulenburger, Paul R. C. Kent, Pierre‐François Loos, Anthony Scemama, Michel Caffarel

Published Nov 11, 2020• 29 citations

Publisher

Abstract

While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for ab initio electronic structure calculations, in practice, the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros). This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced. This approach is illustrated in the case of the carbon diamond using Slater-Jastrow trial wavefunctions including up to one million Slater determinants. Fixed-node DMC energies obtained with such large expansions are much improved, and the fixed-node error is found to decrease monotonically and smoothly as a function of the number of determinants in the trial wavefunction, a property opening the way to a better control of this error. The cohesive energy extrapolated to the thermodynamic limit is in close agreement with the estimated experimental value. Interestingly, this is also the case at the single-determinant level, thus, indicating a very good error cancellation in carbon diamond between the bulk and atomic total fixed-node energies when using single-determinant nodes.

DOI: 10.1063/5.0021036

Related papers

Towards a Systematic Improvement of the Fixed-Node Approximation in Diffusion Monte Carlo for Solids -- A Case Study In Diamond

Anouar Benali, Kevin E. Gasperich, Kenneth D. Jordan +9 more

While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for \textit{ab initio} electronic structure calculations, in practice the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros) must be used. This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced.

arXiv:2007.11673Jul 22, 20200 citations

Self-healing diffusion quantum Monte Carlo algorithms: Direct reduction of the fermion sign error in electronic structure calculations

Fernando Agustín Reboredo, Randolph Q. Hood, Paul R. C. Kent

We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.

arXiv:0808.3417Physical Review BMay 19, 200930 citations

Beyond Single-Reference Fixed-Node Approximation in Ab Initio Diffusion Monte Carlo Using Antisymmetrized Geminal Power Applied to Systems with Hundreds of Electrons

Kousuke Nakano, Sandro Sorella, Dario Alfè +1 more

High Resolution Image Download MS PowerPoint Slide Diffusion Monte Carlo (DMC) is an exact technique to project out the ground state (GS) of a Hamiltonian. Since the GS is always bosonic, in Fermionic systems, the projection needs to be carried out while imposing antisymmetric constraints, which is a nondeterministic polynomial hard problem. In practice, therefore, the application of DMC on electronic structure problems is made by employing the fixed-node (FN) approximation, consisting of performing DMC with the constraint of having a fixed, predefined nodal surface. How do we get the nodal surface? The typical approach, applied in systems having up to hundreds or even thousands of electrons, is to obtain the nodal surface from a preliminary mean-field approach (typically, a density functional theory calculation) used to obtain a single Slater determinant. This is known as single reference. In this paper, we propose a new approach, applicable to systems as large as the C 60 fullerene, which improves the nodes by going beyond the single reference. In practice, we employ an implicitly multireference ansatz (antisymmetrized geminal power wave function constraint with molecular orbitals), initialized on the preliminary mean-field approach, which is relaxed by optimizing a few parameters of the wave function determining the nodal surface by minimizing the FN-DMC energy. We highlight the improvements of the proposed approach over the standard single-reference method on several examples and, where feasible, the computational gain over the standard multireference ansatz, which makes the methods applicable to large systems. We also show that physical properties relying on relative energies, such as binding energies, are affordable and reliable within the proposed scheme.

arXiv:2402.01458Journal of Chemical Theory and ComputationMay 24, 20246 citations

Systematic comparison and cross-validation of fixed-node diffusion Monte Carlo and phaseless auxiliary-field quantum Monte Carlo in solids

Fionn D. Malone, Anouar Benali, Miguel A. Morales +3 more

Quantum Monte Carlo (QMC) methods are some of the most accurate methods for simulating correlated electronic systems. We investigate the compatibility, strengths, and weaknesses of two such methods, namely, diffusion Monte Carlo (DMC) and auxiliary-field quantum Monte Carlo (AFQMC). The multideterminant trial wave functions employed in both approaches are generated using the configuration interaction using a perturbative selection made iteratively (CIPSI) technique. Complete basis-set full configuration interaction energies estimated with CIPSI are used as a reference in this comparative study between DMC and AFQMC. By focusing on a set of canonical finite--size solid-state systems, we show that both QMC methods can be made to systematically converge towards the same energy once basis-set effects and systematic biases have been removed. AFQMC shows a much smaller dependence on the trial wave function than DMC while simultaneously exhibiting a much larger basis-set dependence. We outline some of the remaining challenges and opportunities for improving these approaches.

arXiv:2007.05587Physical review. B./Physical review. BOct 7, 202026 citations

Towards the ground state of molecules via diffusion Monte Carlo on neural networks

Weiluo Ren, Weizhong Fu, Xiaojie Wu +1 more

Diffusion Monte Carlo (DMC) based on fixed-node approximation has enjoyed significant developments in the past decades and become one of the go-to methods when accurate ground state energy of molecules and materials is needed. However, the inaccurate nodal structure hinders the application of DMC for more challenging electronic correlation problems. In this work, we apply the neural-network based trial wavefunction in fixed-node DMC, which allows accurate calculations of a broad range of atomic and molecular systems of different electronic characteristics. Our method is superior in both accuracy and efficiency compared to state-of-the-art neural network methods using variational Monte Carlo (VMC). We also introduce an extrapolation scheme based on the empirical linearity between VMC and DMC energies, and significantly improve our binding energy calculation. Overall, this computational framework provides a benchmark for accurate solutions of correlated electronic wavefunction and also sheds light on the chemical understanding of molecules.

arXiv:2204.13903Nature CommunicationsApr 3, 202360 citations

Calculation of Intermolecular Interactions via Diffusion Monte Carlo

Kevin E. Gasperich

Quantum chemistry is a useful tool that provides insight into the properties and behavior of chemical systems. Modern software packages have made quantum chemistry methods more easily accessible, and the continued increase in available computational resources has allowed them to be applied to larger systems at higher levels of theory. Two significant problems that the field faces are the high computational complexity of high-level methods and the shift toward parallelism in high performance computing architectures. This work examines the treatment of weakly interacting molecular systems with the fixed-node diffusion Monte Carlo (DMC) method. DMC and other quantum Monte Carlo (QMC) methods offer a possible solution to both of the aforementioned problems: they can produce near-exact results with a lower scaling (with respect to problem size) than other similarly-accurate methods, and they are inherently parallel, so there is little additional cost associated with distributing the work of a single QMC calculation across a large number of processing units. The only error in DMC that is not systematically improvable is the constraint of a fixed nodal surface of the many-particle wave function of the system being studied. There are many cases in which a single Slater determinant trial function is sufficient to obtain accurate results, but there are others in which more sophisticated multi-determinant trial functions are necessary. Furthermore, it is non-trivial to generate nodal surfaces of similar quality for isolated and interacting molecules, so cancellation of errors is not guaranteed. We examine the use of different single- and multi-determinant trial functions in DMC calculations on small chemical systems with the goal of further understanding how to construct appropriate trial functions for molecules and clusters.

Jan 16, 20200 citations