Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

The Journal of Chemical Physics

Fermion Monte Carlo without fixed nodes: A game of life, death, and annihilation in Slater determinant space

George H. Booth, Alex J. W. Thom, Ali Alavi

Published Aug 4, 2009• 822 citations
Publisher

Abstract

We have developed a new quantum Monte Carlo method for the simulation of correlated many-electron systems in full configuration-interaction (Slater determinant) spaces. The new method is a population dynamics of a set of walkers, and is designed to simulate the underlying imaginary-time Schrödinger equation of the interacting Hamiltonian. The walkers (which carry a positive or negative sign) inhabit Slater determinant space, and evolve according to a simple set of rules which include spawning, death and annihilation processes. We show that this method is capable of converging onto the full configuration-interaction (FCI) energy and wave function of the problem, without any a priori information regarding the nodal structure of the wave function being provided. Walker annihilation is shown to play a key role. The pattern of walker growth exhibits a characteristic plateau once a critical (system-dependent) number of walkers has been reached. At this point, the correlation energy can be measured using two independent methods--a projection formula and a energy shift; agreement between these provides a strong measure of confidence in the accuracy of the computed correlation energies. We have verified the method by performing calculations on systems for which FCI calculations already exist. In addition, we report on a number of new systems, including CO, O(2), CH(4), and NaH--with FCI spaces ranging from 10(9) to 10(14), whose FCI energies we compute using modest computational resources.

DOI
10.1063/1.3193710

Related papers

Quantum Monte Carlo approach to the Full CI problem

Ali Alavi

The ground-state eigenvalue problem posed by the electronic Schrodinger equation can be cast as a stochastic process involving an annihilating population of positive and negative walkers that inhabit Slater determinant space [1]. The population of walkers evolve according to a simple set of rules (akin to a “game of life”), which are derived from the underlying imaginary-time Schrodinger equation, such that the long-time distribution of the walkers matches the exact ground-state eigenvector. We show that this algorithm has a remarkable emergence characteristic, akin to symmetry-breaking phase transitions in classical statistical mechanical systems. The use of Slater determinants obviates the usual Fermion sign problem of diffusion Monte Carlo (namely the collapse onto Bosonic wavefunctions), but instead introduces a different sign problem associated the fact that the off-diagonal Hamiltonian matrix elements are both positive and negative. This sign problem however can be solved through a combination of walker annihilation and a “survival of the fittest” criterion [2] (the latter greatly reducing the dependence of the algorithm on walker annihilation). The method provides a way to compute exact electronic energies within a specified N-electron basis set. We will give examples of the algorithm at work in real systems in sizeable basis sets, ranging from atomic ionization potentials and electron affinities, to dissociation energies of diatomic molecules. Finally, we discuss the scaling of the algorithm with the number of electrons and orbitals [3].

•Jan 1, 2011•0 citations

Fixed- and Partial-Node Approximations in Slater Determinant Space for Molecules

Nick S. Blunt

We present a study of fixed- and partial-node approximations in Slater determinant basis sets, using full configuration interaction quantum Monte Carlo (FCIQMC) to perform sampling. Walker annihilation in the FCIQMC method allows partial-node simulations to be performed, relaxing the nodal constraint to converge to the FCI solution. This is applied to ab initio molecular systems, using symmetry-projected Jastrow mean-field wave functions for complete active space (CAS) problems. Convergence and the sign problem within the partial-node approximation are studied, which is shown to eventually be limited in its use due to the large walker populations required. However, the fixed-node approximation results in an accurate and practical method. We apply these approaches to various molecular systems and active spaces, including ferrocene and acenes. This also provides a test of symmetry-projected Jastrow mean-field wave functions in variational Monte Carlo for a new set of problems. For trans -polyacetylene molecules and acenes, we find that the time to perform a constant number of fixed-node FCIQMC iterations scales as and, respectively, resulting in an efficient method for CAS-based problems that can be applied accurately to large active spaces.

arXiv:2105.09875•Journal of Chemical Theory and Computation•Sep 22, 2021•5 citations

Communications: Survival of the fittest: Accelerating convergence in full configuration-interaction quantum Monte Carlo

Deidre M. Cleland, George H. Booth, Ali Alavi

We provide a very simple adaptation of our recently published quantum Monte Carlo algorithm in full configuration-interaction (Slater determinant) spaces which dramatically reduces the number of walkers required to achieve convergence. A survival criterion is imposed for newly spawned walkers. We define a set of initiator determinants such that progeny of walkers spawned from such determinants onto unoccupied determinants are able to survive, while the progeny of walkers not in this set can survive only if they are spawned onto determinants which are already occupied. The set of initiators is originally defined to be all determinants constructable from a subset of orbitals, in analogy with complete-active spaces. This set is dynamically updated so that if a noninitiator determinant reaches an occupation larger than a preset limit, it becomes an initiator. The new algorithm allows sign-coherent sampling of the FCI space to be achieved with relatively few walkers. Using the N(2) molecule as an illustration, we show that rather small initiator spaces and numbers of walkers can converge with submilliHartree accuracy to the known full configuration-interaction (FCI) energy (in the cc-pVDZ basis), in both the equilibrium geometry and the multiconfigurational stretched case. We use the same method to compute the energy with cc-pVTZ and cc-pVQZ basis sets, the latter having an FCI space of over 10(15) with very modest computational resources.

The Journal of Chemical Physics•Jan 28, 2010•392 citations

The sign problem and population dynamics in the full configuration interaction quantum Monte Carlo method

J. S. Spencer, Nick S. Blunt, W. M. C. Foulkes

The recently proposed full configuration interaction quantum Monte Carlo method allows access to essentially exact ground-state energies of systems of interacting fermions substantially larger than previously tractable without knowledge of the nodal structure of the ground-state wave function. We investigate the nature of the sign problem in this method and how its severity depends on the system studied. We explain how cancellation of the positive and negative particles sampling the wave function ensures convergence to a stochastic representation of the many-fermion ground state and accounts for the characteristic population dynamics observed in simulations.

arXiv:1110.5479•The Journal of Chemical Physics•Feb 6, 2012•108 citations

Improved walker population control for full configuration interaction quantum Monte Carlo

Mingrui Yang, Elke Pahl, Joachim Brand

Full configuration interaction quantum Monte Carlo (FCIQMC) is a stochastic approach for finding the ground state of a quantum many-body Hamiltonian. It is based on the dynamical evolution of a walker population in Hilbert space, which samples the ground state configuration vector over many iterations. Here, we present a modification of the original protocol for walker population control of Booth et al. [J. Chem. Phys. 131, 054106 (2009)] in order to achieve equilibration at a pre-defined average walker number and to avoid walker number overshoots. The dynamics of the walker population is described by a noisy damped harmonic oscillator and controlled by two parameters responsible for damping and forcing, respectively, for which reasonable values are suggested. We further introduce a population growth witness that can be used to detect annihilation plateaus related to overcoming the FCIQMC sign problem. Features of the new population control procedure such as precise walker number control and fast equilibration are demonstrated. The standard error of the shift estimator for the ground state energy as well as the population control bias is found to be unaffected by the population control procedure or its parameters. The improved control of the walker number, and thereby memory consumption, is a desirable feature required for automating FCIQMC calculations and requires minimal modifications to the existing code.

arXiv:2008.01927•The Journal of Chemical Physics•Nov 2, 2020•20 citations

An explicitly correlated approach to basis set incompleteness in full configuration interaction quantum Monte Carlo

George H. Booth, Deidre M. Cleland, Ali Alavi +1 more

By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.

arXiv:1208.0980•The Journal of Chemical Physics•Oct 28, 2012•60 citations
We have developed a new quantum Monte Carlo method for the simulation of correlated many-electron systems in full configuration-interaction (Slater determinant) spaces. The new method is a population dynamics of a set of walkers, and is designed to simulate the underlying imaginary-time Schrödinger equation of the interacting Hamiltonian. The walkers (which carry a positive or negative sign) inhabit Slater determinant space, and evolve according to a simple set of rules which include spawning, death and annihilation processes. We show that this method is capable of converging onto the full configuration-interaction (FCI) energy and wave function of the problem, without any a priori information regarding the nodal structure of the wave function being provided. Walker annihilation is shown to play a key role. The pattern of walker growth exhibits a characteristic plateau once a critical (system-dependent) number of walkers has been reached. At this point, the correlation energy can be measured using two independent methods--a projection formula and a energy shift; agreement between these provides a strong measure of confidence in the accuracy of the computed correlation energies. We have verified the method by performing calculations on systems for which FCI calculations already exist. In addition, we report on a number of new systems, including CO, O(2), CH(4), and NaH--with FCI spaces ranging from 10(9) to 10(14), whose FCI energies we compute using modest computational resources.
The ground-state eigenvalue problem posed by the electronic Schrodinger equation can be cast as a stochastic process involving an annihilating population of positive and negative walkers that inhabit Slater determinant space [1]. The population of walkers evolve according to a simple set of rules (akin to a “game of life”), which are derived from the underlying imaginary-time Schrodinger equation, such that the long-time distribution of the walkers matches the exact ground-state eigenvector. We show that this algorithm has a remarkable emergence characteristic, akin to symmetry-breaking phase transitions in classical statistical mechanical systems. The use of Slater determinants obviates the usual Fermion sign problem of diffusion Monte Carlo (namely the collapse onto Bosonic wavefunctions), but instead introduces a different sign problem associated the fact that the off-diagonal Hamiltonian matrix elements are both positive and negative. This sign problem however can be solved through a combination of walker annihilation and a “survival of the fittest” criterion [2] (the latter greatly reducing the dependence of the algorithm on walker annihilation). The method provides a way to compute exact electronic energies within a specified N-electron basis set. We will give examples of the algorithm at work in real systems in sizeable basis sets, ranging from atomic ionization potentials and electron affinities, to dissociation energies of diatomic molecules. Finally, we discuss the scaling of the algorithm with the number of electrons and orbitals [3].
We present a study of fixed- and partial-node approximations in Slater determinant basis sets, using full configuration interaction quantum Monte Carlo (FCIQMC) to perform sampling. Walker annihilation in the FCIQMC method allows partial-node simulations to be performed, relaxing the nodal constraint to converge to the FCI solution. This is applied to ab initio molecular systems, using symmetry-projected Jastrow mean-field wave functions for complete active space (CAS) problems. Convergence and the sign problem within the partial-node approximation are studied, which is shown to eventually be limited in its use due to the large walker populations required. However, the fixed-node approximation results in an accurate and practical method. We apply these approaches to various molecular systems and active spaces, including ferrocene and acenes. This also provides a test of symmetry-projected Jastrow mean-field wave functions in variational Monte Carlo for a new set of problems. For trans -polyacetylene molecules and acenes, we find that the time to perform a constant number of fixed-node FCIQMC iterations scales as and, respectively, resulting in an efficient method for CAS-based problems that can be applied accurately to large active spaces.
We provide a very simple adaptation of our recently published quantum Monte Carlo algorithm in full configuration-interaction (Slater determinant) spaces which dramatically reduces the number of walkers required to achieve convergence. A survival criterion is imposed for newly spawned walkers. We define a set of initiator determinants such that progeny of walkers spawned from such determinants onto unoccupied determinants are able to survive, while the progeny of walkers not in this set can survive only if they are spawned onto determinants which are already occupied. The set of initiators is originally defined to be all determinants constructable from a subset of orbitals, in analogy with complete-active spaces. This set is dynamically updated so that if a noninitiator determinant reaches an occupation larger than a preset limit, it becomes an initiator. The new algorithm allows sign-coherent sampling of the FCI space to be achieved with relatively few walkers. Using the N(2) molecule as an illustration, we show that rather small initiator spaces and numbers of walkers can converge with submilliHartree accuracy to the known full configuration-interaction (FCI) energy (in the cc-pVDZ basis), in both the equilibrium geometry and the multiconfigurational stretched case. We use the same method to compute the energy with cc-pVTZ and cc-pVQZ basis sets, the latter having an FCI space of over 10(15) with very modest computational resources.
The recently proposed full configuration interaction quantum Monte Carlo method allows access to essentially exact ground-state energies of systems of interacting fermions substantially larger than previously tractable without knowledge of the nodal structure of the ground-state wave function. We investigate the nature of the sign problem in this method and how its severity depends on the system studied. We explain how cancellation of the positive and negative particles sampling the wave function ensures convergence to a stochastic representation of the many-fermion ground state and accounts for the characteristic population dynamics observed in simulations.
Full configuration interaction quantum Monte Carlo (FCIQMC) is a stochastic approach for finding the ground state of a quantum many-body Hamiltonian. It is based on the dynamical evolution of a walker population in Hilbert space, which samples the ground state configuration vector over many iterations. Here, we present a modification of the original protocol for walker population control of Booth et al. [J. Chem. Phys. 131, 054106 (2009)] in order to achieve equilibration at a pre-defined average walker number and to avoid walker number overshoots. The dynamics of the walker population is described by a noisy damped harmonic oscillator and controlled by two parameters responsible for damping and forcing, respectively, for which reasonable values are suggested. We further introduce a population growth witness that can be used to detect annihilation plateaus related to overcoming the FCIQMC sign problem. Features of the new population control procedure such as precise walker number control and fast equilibration are demonstrated. The standard error of the shift estimator for the ground state energy as well as the population control bias is found to be unaffected by the population control procedure or its parameters. The improved control of the walker number, and thereby memory consumption, is a desirable feature required for automating FCIQMC calculations and requires minimal modifications to the existing code.
By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.