Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

The Journal of Chemical Physics

Active space selection with self-healing diffusion Monte Carlo algorithms for periodic solids

Nicole Spanedda, Jaron T. Krogel, Fernando Agustín Reboredo

Published Aug 3, 2026• 0 citations
Publisher

Abstract

Multideterminant Diffusion Monte Carlo (DMC) displays improved accuracy over single determinant DMC. Self-Healing Diffusion Monte Carlo (SHDMC) is a DMC based method that iteratively improves a multideterminant trial wavefunction. Although configuration interaction or complete active space (CAS) methods are very accurate and computationally feasible for many systems, they are not optimal for application to solids. SHDMC is accurate and designed for application to solids, so developing SHDMC based active space selection algorithms is a worthy endeavor. Here, we present and compare active space selection algorithms that are designed for use in conjunction with SHDMC, without relying on external approaches. For benchmarking, we calculated the ground state energy of a small unit cell of graphene and compared the results with a complete basis set extrapolated selected CI and a reference SHDMC trajectory. We found that systematically expanding the active space using an "auto-branching" algorithm optimally balances accuracy with computational practicality. To the best of our knowledge, this is the first work that demonstrates completely self-contained DMC-based active space selection algorithms that do not depend on external methods for determinant selection.

DOI
10.1063/5.0344262

Related papers

Systematic Reduction of Sign Errors in Many-Body Calculations of Atoms and Molecules

Michal Bajdich, Murilo L. Tiago, Randolph Q. Hood +2 more

The self-healing diffusion Monte Carlo algorithm (SHDMC) is shown to be an accurate and robust method for calculating the ground state of atoms and molecules. By direct comparison with accurate configuration interaction results for the oxygen atom, we show that SHDMC converges systematically towards the ground-state wave function. We present results for the challenging N2 molecule, where the binding energies obtained via both energy minimization and SHDMC are near chemical accuracy (1 kcal/mol). Moreover, we demonstrate that SHDMC is robust enough to find the nodal surface for systems at least as large as C20 starting from random coefficients. SHDMC is a linear-scaling method, in the degrees of freedom of the nodes, that systematically reduces the fermion sign problem.

arXiv:0912.3826•Physical Review Letters•May 11, 2010•30 citations

Multireference diffusion Monte Carlo reaches 2D materials

Nicole Spanedda, Anouar Benali, Fernando Agustín Reboredo +1 more

Quantum confinement in 2D materials strongly enhances electronic correlation effects. Therefore, predicting the properties of these unique materials, with both a high level of accuracy and computational efficiency, without relying on adjustable parameters or functionals, remains an outstanding theoretical challenge. The majority of theoretical studies are based on the approximations of density functional theory (DFT). The reliability of DFT predictions are heavily dependent on the choice of an approximated exchange-correlation functional. Here, we estimate the magnitude of impact of correlation on the total energy for the quintessential 2D material, graphene, by performing and comparing state-of-the-art selected CI and quantum Monte Carlo extrapolated calculations for a single unit cell at the Γ point. We demonstrate that Self-Healing Diffusion Monte Carlo (SHDMC) obtains a very compact, but high-quality wavefunction for this system that lacks the strong basis set dependence displayed by state of the art quantum chemistry methods. The SHDMC wavefunction is of higher quality compared to that obtained from sCI, in the same orbital basis, while being ∼ 1000 times smaller in terms of determinant count compared to sCI. We also demonstrate that extrapolating SHDMC results to the infinite determinant limit compares extremely well with complete basis set extrapolated sCI. Our work paves the way for future validation of SHDMC applied to challenging 2D materials.

Scientific Reports•Sep 26, 2025•4 citations

Self-healing diffusion quantum Monte Carlo algorithms: Direct reduction of the fermion sign error in electronic structure calculations

Fernando Agustín Reboredo, Randolph Q. Hood, Paul R. C. Kent

We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.

arXiv:0808.3417•Physical Review B•May 19, 2009•30 citations

Self-Healing Diffusion Monte Carlo applied to a simple fermionic model: A critical assessment of the method

Michel Caffarel, Manon Pinar, Anthony Scemama

We investigate the Self-Healing Diffusion Monte Carlo (SHDMC) method using a one-dimensional model with periodic boundary conditions. An inversion symmetry is introduced to mimic the antisymmetry property of fermionic wave functions, with the bosonic and fermionic sectors being modeled by the even and odd eigenstates, respectively. As in realistic fermionic systems, the nodal structure is only partially constrained by symmetry, making this model a non-trivial testbed for nodal optimization algorithms such as SHDMC. We show that the nodal evolution under SHDMC iterations can be cast into a dynamical system exhibiting both attractive and repulsive fixed points. When applying SHDMC to this model in the absence of statistical noise, the fixed-node energy is found to increase during iterations and the node converges to an incorrect value. This occurs for any finite basis, even when the exact node is representable in it; the attractive fixed point approaches the exact node only as the basis becomes complete, while the convergence toward it becomes increasingly slow. We further show that this problem can be largely cured by modifying the nodal update criterion to give more importance to the nodal region. Our results suggest that, in the general case, an efficient nodal optimization may require both an improved nodal update criterion and a localized basis set allowing local distortions of the trial wave function, as is the case for this model.

arXiv:2609.01301•Sep 1, 2026•0 citations

Systematic comparison and cross-validation of fixed-node diffusion Monte Carlo and phaseless auxiliary-field quantum Monte Carlo in solids

Fionn D. Malone, Anouar Benali, Miguel A. Morales +3 more

Quantum Monte Carlo (QMC) methods are some of the most accurate methods for simulating correlated electronic systems. We investigate the compatibility, strengths, and weaknesses of two such methods, namely, diffusion Monte Carlo (DMC) and auxiliary-field quantum Monte Carlo (AFQMC). The multideterminant trial wave functions employed in both approaches are generated using the configuration interaction using a perturbative selection made iteratively (CIPSI) technique. Complete basis-set full configuration interaction energies estimated with CIPSI are used as a reference in this comparative study between DMC and AFQMC. By focusing on a set of canonical finite--size solid-state systems, we show that both QMC methods can be made to systematically converge towards the same energy once basis-set effects and systematic biases have been removed. AFQMC shows a much smaller dependence on the trial wave function than DMC while simultaneously exhibiting a much larger basis-set dependence. We outline some of the remaining challenges and opportunities for improving these approaches.

arXiv:2007.05587•Physical review. B./Physical review. B•Oct 7, 2020•26 citations

Many-body calculations of low-energy eigenstates in magnetic and periodic systems with self-healing diffusion Monte Carlo: Steps beyond the fixed phase

Fernando Agustín Reboredo

The self-healing diffusion Monte Carlo algorithm (SHDMC) [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009); F. A. Reboredo, ibid. 80, 125110 (2009)] is extended to study the ground and excited states of magnetic and periodic systems. The method converges to exact eigenstates as the statistical data collected increase if the wave function is sufficiently flexible. It is shown that the dimensionality of the nodal surface is dependent on whether phase is a scalar function or not. A recursive optimization algorithm is derived from the time evolution of the mixed probability density, which is given by an ensemble of electronic configurations (walkers) with complex weight. This complex weight allows the phase of the fixed-node wave function to move away from the trial wave function phase. This novel approach is both a generalization of SHDMC and the fixed-phase approximation [G. Ortiz, D. M. Ceperley, and R. M. Martin, Phys Rev. Lett. 71, 2777 (1993)]. When used recursively it simultaneously improves the node and the phase. The algorithm is demonstrated to converge to nearly exact solutions of model systems with periodic boundary conditions or applied magnetic fields. The computational cost is proportional to the number of independent degrees of freedom of the phase. The method is applied to obtain low-energy excitations of Hamiltonians with magnetic field. Periodic boundary conditions are also considered optimizing wave functions with twisted boundary conditions which are included in a many-body Bloch phase. The potential applications of this new method to study periodic, magnetic, and complex Hamiltonians are discussed.

arXiv:1008.0359•The Journal of Chemical Physics•May 22, 2012•9 citations
Multideterminant Diffusion Monte Carlo (DMC) displays improved accuracy over single determinant DMC. Self-Healing Diffusion Monte Carlo (SHDMC) is a DMC based method that iteratively improves a multideterminant trial wavefunction. Although configuration interaction or complete active space (CAS) methods are very accurate and computationally feasible for many systems, they are not optimal for application to solids. SHDMC is accurate and designed for application to solids, so developing SHDMC based active space selection algorithms is a worthy endeavor. Here, we present and compare active space selection algorithms that are designed for use in conjunction with SHDMC, without relying on external approaches. For benchmarking, we calculated the ground state energy of a small unit cell of graphene and compared the results with a complete basis set extrapolated selected CI and a reference SHDMC trajectory. We found that systematically expanding the active space using an "auto-branching" algorithm optimally balances accuracy with computational practicality. To the best of our knowledge, this is the first work that demonstrates completely self-contained DMC-based active space selection algorithms that do not depend on external methods for determinant selection.
The self-healing diffusion Monte Carlo algorithm (SHDMC) is shown to be an accurate and robust method for calculating the ground state of atoms and molecules. By direct comparison with accurate configuration interaction results for the oxygen atom, we show that SHDMC converges systematically towards the ground-state wave function. We present results for the challenging N2 molecule, where the binding energies obtained via both energy minimization and SHDMC are near chemical accuracy (1 kcal/mol). Moreover, we demonstrate that SHDMC is robust enough to find the nodal surface for systems at least as large as C20 starting from random coefficients. SHDMC is a linear-scaling method, in the degrees of freedom of the nodes, that systematically reduces the fermion sign problem.
Quantum confinement in 2D materials strongly enhances electronic correlation effects. Therefore, predicting the properties of these unique materials, with both a high level of accuracy and computational efficiency, without relying on adjustable parameters or functionals, remains an outstanding theoretical challenge. The majority of theoretical studies are based on the approximations of density functional theory (DFT). The reliability of DFT predictions are heavily dependent on the choice of an approximated exchange-correlation functional. Here, we estimate the magnitude of impact of correlation on the total energy for the quintessential 2D material, graphene, by performing and comparing state-of-the-art selected CI and quantum Monte Carlo extrapolated calculations for a single unit cell at the Γ point. We demonstrate that Self-Healing Diffusion Monte Carlo (SHDMC) obtains a very compact, but high-quality wavefunction for this system that lacks the strong basis set dependence displayed by state of the art quantum chemistry methods. The SHDMC wavefunction is of higher quality compared to that obtained from sCI, in the same orbital basis, while being ∼ 1000 times smaller in terms of determinant count compared to sCI. We also demonstrate that extrapolating SHDMC results to the infinite determinant limit compares extremely well with complete basis set extrapolated sCI. Our work paves the way for future validation of SHDMC applied to challenging 2D materials.
We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.
We investigate the Self-Healing Diffusion Monte Carlo (SHDMC) method using a one-dimensional model with periodic boundary conditions. An inversion symmetry is introduced to mimic the antisymmetry property of fermionic wave functions, with the bosonic and fermionic sectors being modeled by the even and odd eigenstates, respectively. As in realistic fermionic systems, the nodal structure is only partially constrained by symmetry, making this model a non-trivial testbed for nodal optimization algorithms such as SHDMC. We show that the nodal evolution under SHDMC iterations can be cast into a dynamical system exhibiting both attractive and repulsive fixed points. When applying SHDMC to this model in the absence of statistical noise, the fixed-node energy is found to increase during iterations and the node converges to an incorrect value. This occurs for any finite basis, even when the exact node is representable in it; the attractive fixed point approaches the exact node only as the basis becomes complete, while the convergence toward it becomes increasingly slow. We further show that this problem can be largely cured by modifying the nodal update criterion to give more importance to the nodal region. Our results suggest that, in the general case, an efficient nodal optimization may require both an improved nodal update criterion and a localized basis set allowing local distortions of the trial wave function, as is the case for this model.
Quantum Monte Carlo (QMC) methods are some of the most accurate methods for simulating correlated electronic systems. We investigate the compatibility, strengths, and weaknesses of two such methods, namely, diffusion Monte Carlo (DMC) and auxiliary-field quantum Monte Carlo (AFQMC). The multideterminant trial wave functions employed in both approaches are generated using the configuration interaction using a perturbative selection made iteratively (CIPSI) technique. Complete basis-set full configuration interaction energies estimated with CIPSI are used as a reference in this comparative study between DMC and AFQMC. By focusing on a set of canonical finite--size solid-state systems, we show that both QMC methods can be made to systematically converge towards the same energy once basis-set effects and systematic biases have been removed. AFQMC shows a much smaller dependence on the trial wave function than DMC while simultaneously exhibiting a much larger basis-set dependence. We outline some of the remaining challenges and opportunities for improving these approaches.
The self-healing diffusion Monte Carlo algorithm (SHDMC) [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009); F. A. Reboredo, ibid. 80, 125110 (2009)] is extended to study the ground and excited states of magnetic and periodic systems. The method converges to exact eigenstates as the statistical data collected increase if the wave function is sufficiently flexible. It is shown that the dimensionality of the nodal surface is dependent on whether phase is a scalar function or not. A recursive optimization algorithm is derived from the time evolution of the mixed probability density, which is given by an ensemble of electronic configurations (walkers) with complex weight. This complex weight allows the phase of the fixed-node wave function to move away from the trial wave function phase. This novel approach is both a generalization of SHDMC and the fixed-phase approximation [G. Ortiz, D. M. Ceperley, and R. M. Martin, Phys Rev. Lett. 71, 2777 (1993)]. When used recursively it simultaneously improves the node and the phase. The algorithm is demonstrated to converge to nearly exact solutions of model systems with periodic boundary conditions or applied magnetic fields. The computational cost is proportional to the number of independent degrees of freedom of the phase. The method is applied to obtain low-energy excitations of Hamiltonians with magnetic field. Periodic boundary conditions are also considered optimizing wave functions with twisted boundary conditions which are included in a many-body Bloch phase. The potential applications of this new method to study periodic, magnetic, and complex Hamiltonians are discussed.