Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2007.11673

Towards a Systematic Improvement of the Fixed-Node Approximation in Diffusion Monte Carlo for Solids -- A Case Study In Diamond

Anouar Benali, Kevin E. Gasperich, Kenneth D. Jordan, Thomas Applencourt, Ye Luo, M. Chandler Bennett, Jaron T. Krogel, Luke Shulenburger, Paul R. C. Kent, Pierre‐François Loos, Anthony Scemama, Michel Caffarel

Published Jul 22, 2020• 0 citations
arXivHTMLPDF

Abstract

While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for \textit{ab initio} electronic structure calculations, in practice the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros) must be used. This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced.

DOI
10.48550/arxiv.2007.11673

Related papers

Toward a systematic improvement of the fixed-node approximation in diffusion Monte Carlo for solids—A case study in diamond

Anouar Benali, Kevin E. Gasperich, Kenneth D. Jordan +9 more

While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for ab initio electronic structure calculations, in practice, the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros). This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced. This approach is illustrated in the case of the carbon diamond using Slater-Jastrow trial wavefunctions including up to one million Slater determinants. Fixed-node DMC energies obtained with such large expansions are much improved, and the fixed-node error is found to decrease monotonically and smoothly as a function of the number of determinants in the trial wavefunction, a property opening the way to a better control of this error. The cohesive energy extrapolated to the thermodynamic limit is in close agreement with the estimated experimental value. Interestingly, this is also the case at the single-determinant level, thus, indicating a very good error cancellation in carbon diamond between the bulk and atomic total fixed-node energies when using single-determinant nodes.

The Journal of Chemical Physics•Nov 11, 2020•29 citations

Self-healing diffusion quantum Monte Carlo algorithms: Direct reduction of the fermion sign error in electronic structure calculations

Fernando Agustín Reboredo, Randolph Q. Hood, Paul R. C. Kent

We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.

arXiv:0808.3417•Physical Review B•May 19, 2009•30 citations

Systematic comparison and cross-validation of fixed-node diffusion Monte Carlo and phaseless auxiliary-field quantum Monte Carlo in solids

Fionn D. Malone, Anouar Benali, Miguel A. Morales +3 more

Quantum Monte Carlo (QMC) methods are some of the most accurate methods for simulating correlated electronic systems. We investigate the compatibility, strengths, and weaknesses of two such methods, namely, diffusion Monte Carlo (DMC) and auxiliary-field quantum Monte Carlo (AFQMC). The multideterminant trial wave functions employed in both approaches are generated using the configuration interaction using a perturbative selection made iteratively (CIPSI) technique. Complete basis-set full configuration interaction energies estimated with CIPSI are used as a reference in this comparative study between DMC and AFQMC. By focusing on a set of canonical finite--size solid-state systems, we show that both QMC methods can be made to systematically converge towards the same energy once basis-set effects and systematic biases have been removed. AFQMC shows a much smaller dependence on the trial wave function than DMC while simultaneously exhibiting a much larger basis-set dependence. We outline some of the remaining challenges and opportunities for improving these approaches.

arXiv:2007.05587•Physical review. B./Physical review. B•Oct 7, 2020•26 citations

Towards the ground state of molecules via diffusion Monte Carlo on neural networks

Weiluo Ren, Weizhong Fu, Xiaojie Wu +1 more

Diffusion Monte Carlo (DMC) based on fixed-node approximation has enjoyed significant developments in the past decades and become one of the go-to methods when accurate ground state energy of molecules and materials is needed. However, the inaccurate nodal structure hinders the application of DMC for more challenging electronic correlation problems. In this work, we apply the neural-network based trial wavefunction in fixed-node DMC, which allows accurate calculations of a broad range of atomic and molecular systems of different electronic characteristics. Our method is superior in both accuracy and efficiency compared to state-of-the-art neural network methods using variational Monte Carlo (VMC). We also introduce an extrapolation scheme based on the empirical linearity between VMC and DMC energies, and significantly improve our binding energy calculation. Overall, this computational framework provides a benchmark for accurate solutions of correlated electronic wavefunction and also sheds light on the chemical understanding of molecules.

arXiv:2204.13903•Nature Communications•Apr 3, 2023•60 citations

A brief introduction to the diffusion Monte Carlo method and the fixed-node approximation

Alfonso Annarelli, Dario Alfè, Andrea Zen

Quantum Monte Carlo (QMC) methods represent a powerful family of computational techniques for tackling complex quantum many-body problems and performing calculations of stationary state properties. QMC is among the most accurate and powerful approaches to the study of electronic structure, but its application is often hindered by a steep learning curve; hence it is rarely addressed in undergraduate and postgraduate classes. This tutorial is a step toward filling this gap. We offer an introduction to the diffusion Monte Carlo (DMC) method, which aims to solve the imaginary time Schrödinger equation through stochastic sampling of the configuration space. Starting from the theoretical foundations, the discussion leads naturally to the formulation of a step-by-step algorithm. To illustrate how the method works in simplified scenarios, examples such as the harmonic oscillator and the hydrogen atom are provided. The discussion extends to the fixed-node approximation, a crucial approach for addressing the fermionic sign problem in multi-electron systems. In particular, we examine the influence of trial wave function nodal surfaces on the accuracy of DMC energy by evaluating results from a non-interacting two-fermion system. Extending the method to excited states is feasible in principle, but some additional considerations are needed, supported by practical insights. By addressing the fundamental concepts from a hands-on perspective, we hope this tutorial will serve as a valuable guide for researchers and students approaching DMC for the first time.

arXiv:2412.06006•The Journal of Chemical Physics•Dec 28, 2024•9 citations

Symmetry constraints and variational principles in diffusion quantum Monte Carlo calculations of excited-state energies

W. M. C. Foulkes, Randolph Q. Hood, Richard J. Needs

Fixed-node diffusion Monte Carlo (DMC) is a stochastic algorithm for finding the lowest energy many-fermion wave function with the same nodal surface as a chosen trial function. It has proved itself among the most accurate methods available for calculating many-electron ground states, and is one of the few approaches that can be applied to systems large enough to act as realistic models of solids. In attempts to use fixed-node DMC for excited-state calculations, it has often been assumed that the DMC energy must be greater than or equal to the energy of the lowest exact eigenfunction with the same symmetry as the trial function. We show that this assumption is not justified unless the trial function transforms according to a one-dimensional irreducible representation of the symmetry group of the Hamiltonian. If the trial function transforms according to a multidimensional irreducible representation, corresponding to a degenerate energy level, the DMC energy may lie below the energy of the lowest eigenstate of that symmetry. Weaker variational bounds may then be obtained by choosing trial functions transforming according to one-dimensional irreducible representations of subgroups of the full symmetry group.

arXiv:cond-mat/9903204•Physical review. B, Condensed matter•Aug 15, 1999•77 citations
While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for \textit{ab initio} electronic structure calculations, in practice the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros) must be used. This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced.
While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for ab initio electronic structure calculations, in practice, the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros). This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced. This approach is illustrated in the case of the carbon diamond using Slater-Jastrow trial wavefunctions including up to one million Slater determinants. Fixed-node DMC energies obtained with such large expansions are much improved, and the fixed-node error is found to decrease monotonically and smoothly as a function of the number of determinants in the trial wavefunction, a property opening the way to a better control of this error. The cohesive energy extrapolated to the thermodynamic limit is in close agreement with the estimated experimental value. Interestingly, this is also the case at the single-determinant level, thus, indicating a very good error cancellation in carbon diamond between the bulk and atomic total fixed-node energies when using single-determinant nodes.
We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.
Quantum Monte Carlo (QMC) methods are some of the most accurate methods for simulating correlated electronic systems. We investigate the compatibility, strengths, and weaknesses of two such methods, namely, diffusion Monte Carlo (DMC) and auxiliary-field quantum Monte Carlo (AFQMC). The multideterminant trial wave functions employed in both approaches are generated using the configuration interaction using a perturbative selection made iteratively (CIPSI) technique. Complete basis-set full configuration interaction energies estimated with CIPSI are used as a reference in this comparative study between DMC and AFQMC. By focusing on a set of canonical finite--size solid-state systems, we show that both QMC methods can be made to systematically converge towards the same energy once basis-set effects and systematic biases have been removed. AFQMC shows a much smaller dependence on the trial wave function than DMC while simultaneously exhibiting a much larger basis-set dependence. We outline some of the remaining challenges and opportunities for improving these approaches.
Diffusion Monte Carlo (DMC) based on fixed-node approximation has enjoyed significant developments in the past decades and become one of the go-to methods when accurate ground state energy of molecules and materials is needed. However, the inaccurate nodal structure hinders the application of DMC for more challenging electronic correlation problems. In this work, we apply the neural-network based trial wavefunction in fixed-node DMC, which allows accurate calculations of a broad range of atomic and molecular systems of different electronic characteristics. Our method is superior in both accuracy and efficiency compared to state-of-the-art neural network methods using variational Monte Carlo (VMC). We also introduce an extrapolation scheme based on the empirical linearity between VMC and DMC energies, and significantly improve our binding energy calculation. Overall, this computational framework provides a benchmark for accurate solutions of correlated electronic wavefunction and also sheds light on the chemical understanding of molecules.
Quantum Monte Carlo (QMC) methods represent a powerful family of computational techniques for tackling complex quantum many-body problems and performing calculations of stationary state properties. QMC is among the most accurate and powerful approaches to the study of electronic structure, but its application is often hindered by a steep learning curve; hence it is rarely addressed in undergraduate and postgraduate classes. This tutorial is a step toward filling this gap. We offer an introduction to the diffusion Monte Carlo (DMC) method, which aims to solve the imaginary time Schrödinger equation through stochastic sampling of the configuration space. Starting from the theoretical foundations, the discussion leads naturally to the formulation of a step-by-step algorithm. To illustrate how the method works in simplified scenarios, examples such as the harmonic oscillator and the hydrogen atom are provided. The discussion extends to the fixed-node approximation, a crucial approach for addressing the fermionic sign problem in multi-electron systems. In particular, we examine the influence of trial wave function nodal surfaces on the accuracy of DMC energy by evaluating results from a non-interacting two-fermion system. Extending the method to excited states is feasible in principle, but some additional considerations are needed, supported by practical insights. By addressing the fundamental concepts from a hands-on perspective, we hope this tutorial will serve as a valuable guide for researchers and students approaching DMC for the first time.
Fixed-node diffusion Monte Carlo (DMC) is a stochastic algorithm for finding the lowest energy many-fermion wave function with the same nodal surface as a chosen trial function. It has proved itself among the most accurate methods available for calculating many-electron ground states, and is one of the few approaches that can be applied to systems large enough to act as realistic models of solids. In attempts to use fixed-node DMC for excited-state calculations, it has often been assumed that the DMC energy must be greater than or equal to the energy of the lowest exact eigenfunction with the same symmetry as the trial function. We show that this assumption is not justified unless the trial function transforms according to a one-dimensional irreducible representation of the symmetry group of the Hamiltonian. If the trial function transforms according to a multidimensional irreducible representation, corresponding to a degenerate energy level, the DMC energy may lie below the energy of the lowest eigenstate of that symmetry. Weaker variational bounds may then be obtained by choosing trial functions transforming according to one-dimensional irreducible representations of subgroups of the full symmetry group.