Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1407.4800 · Physical Review B

Sign problem in full configuration interaction quantum Monte Carlo: Linear and sublinear representation regimes for the exact wave function

James J. Shepherd, Gustavo E. Scuseria, James S. Spencer

Published Oct 27, 2014• 35 citations
arXivHTMLPDF

Abstract

We investigate the sign problem for full configuration interaction quantum Monte Carlo (FCIQMC), a stochastic algorithm for finding the ground-state solution of the Schr\"odinger equation with substantially reduced computational cost compared with exact diagonalization. We find $k$-space Hubbard models for which the solution is yielded with storage that grows sublinearly in the size of the many-body Hilbert space, in spite of using a wave function that is simply a linear combination of states. The FCIQMC algorithm is able to find this sublinear scaling regime without bias and with only a choice of the Hamiltonian basis. By means of a demonstration we solve for the energy of a 70-site half-filled system (with a space of ${10}^{38}$ determinants) in 250 core hours, substantially quicker than the $\ensuremath{\sim}{10}^{36}$ core hours that would be required by exact diagonalization. This is the largest space that has been sampled in an unbiased fashion. The challenge for the recently developed FCIQMC method is made clear: Expand the sublinear scaling regime while retaining exact-on-average accuracy. We comment upon the relationship between this and the scaling law previously observed in the initiator adaptation (i-FCIQMC). We argue that our results change the landscape for the development of FCIQMC and related methods.

DOI
10.1103/physrevb.90.155130

Related papers

Emergence of Critical Phenomena in Full Configuration Interaction Quantum Monte Carlo

James J. Shepherd, Lauretta R. Schwarz, Robert E. Thomas +3 more

There has been recent literature discussion on the origin and severity of the `sign problem' in full configuration interaction quantum Monte Carlo (FCIQMC) and its `initiator' adaptation (i-FCIQMC), methods of interest and potential because they allow for exact (FCI) ground-state solutions to be obtained often at a much reduced computational cost. In this study we aim to use a simple order parameter, describing the `sign structure' of the stochastic wavefunction representation, to empirically characterise the fundamentally different collective behaviour of the walker population in both methods.

arXiv:1209.4023•Sep 18, 2012•0 citations

Validation of the Ability of Full Configuration Interaction Quantum Monte Carlo for Studying the 2D Hubbard Model

Su-Jun Yun, Tiekuang Dong, S. Konrad Zhu

To validate the ability of full configuration interaction quantum Monte Carlo (FCIQMC) for studying the 2D Hubbard model near half-filling regime, the ground state energies of a 4 × 4 square lattice system with various interaction strengths are calculated. It is found that the calculated results are in good agreement with those obtained by exact diagonalization (i.e., the exact values for a given basis set) when the population of psi particles (psips) is higher than the critical population required to correctly sample the ground state wave function. In addition, the variations of the average computational time per 20 Monte Carlo cycles with the coupling strength and the number of processors are also analyzed. The calculated results show that the computational efficiency of an FCIQMC calculation is mainly affected by the total population of psips and the communication between processors. These results can provide useful references for understanding the FCIQMC algorithm, studying the ground state properties of the 2D Hubbard model for the larger system size by the FCIQMC method and using a computational budget as effectively as possible.

Chinese Physics Letters•Aug 1, 2017•2 citations

Importance-sampling FCIQMC: Solving weak sign-problem systems

Niklas Liebermann, Khaldoon Ghanem, Ali Alavi

We investigate the exact full configuration interaction quantum Monte Carlo algorithm (without the initiator approximation) applied to weak sign-problem fermionic systems, namely, systems in which the energy gap to the corresponding sign-free or “stoquastized” state is small. We show that the minimum number of walkers required to exactly overcome the sign problem can be significantly reduced via an importance-sampling similarity transformation even though the similarity-transformed Hamiltonian has the same stoquastic gap as the untransformed one. Furthermore, we show that in the off-half-filling Hubbard model at U/t = 8, the real-space (site) representation has a much weaker sign problem compared to the momentum space representation. By applying importance sampling using a Gutzwiller-like guiding wavefunction, we are able to substantially reduce the minimum number of walkers in the case of 2 × ℓ Hubbard ladders, enabling us to get exact energies for sizable ladders. With these results, we calculate the fundamental charge gap ΔEfund = E(N + 1) + E(N − 1) − 2E(N) for the ladder systems compared to strictly one-dimensional Hubbard chains and show that the ladder systems have a reduced fundamental gap compared to the 1D chains.

The Journal of Chemical Physics•Sep 6, 2022•4 citations

An explicitly correlated approach to basis set incompleteness in full configuration interaction quantum Monte Carlo

George H. Booth, Deidre M. Cleland, Ali Alavi +1 more

By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.

arXiv:1208.0980•The Journal of Chemical Physics•Oct 28, 2012•60 citations

Semi-stochastic full configuration interaction quantum Monte Carlo: Developments and application

Nick S. Blunt, Simon D. Smart, J. A. F. Kersten +3 more

We expand upon the recent semi-stochastic adaptation to full configuration interaction quantum Monte Carlo (FCIQMC). We present an alternate method for generating the deterministic space without a priori knowledge of the wave function and present stochastic efficiencies for a variety of both molecular and lattice systems. The algorithmic details of an efficient semi-stochastic implementation are presented, with particular consideration given to the effect that the adaptation has on parallel performance in FCIQMC. We further demonstrate the benefit for calculation of reduced density matrices in FCIQMC through replica sampling, where the semi-stochastic adaptation seems to have even larger efficiency gains. We then combine these ideas to produce explicitly correlated corrected FCIQMC energies for the beryllium dimer, for which stochastic errors on the order of wavenumber accuracy are achievable.

arXiv:1502.04847•The Journal of Chemical Physics•May 14, 2015•100 citations

Full configuration interaction quantum Monte Carlo for accurate $\textit{ab initio}$ nuclear structure calculations: algorithms and calculation details

Rongzhe Hu, Furong Xu, Baishan Hu +1 more

Full configuration interaction quantum Monte Carlo (FCIQMC) is a stochastic many-body solver that has been widely applied to electronic, molecular, and condensed-matter systems. In this work we apply FCIQMC to $\textit{ab initio}$ nuclear structure calculations using interactions derived from chiral effective field theory. We describe the algorithm in detail, including imaginary-time propagation, excitation generation, estimator choices, the initiator approximation with adaptive shift correction, and reduced-density-matrix (RDM) sampling. Benchmark calculations in small model spaces, where deterministic full configuration interaction (FCI) results are available, validate the stochastic calculation of energies, radii, and RDM-based pure estimators. For large model spaces, we analyze the residual finite-walker bias through systematic walker-number convergence and infinite-walker extrapolations. We also demonstrate that FCIQMC can be extended beyond ground-state calculations by computing the low-lying spectrum of $^6$Li.

arXiv:2607.05525•Jul 6, 2026•0 citations
We investigate the sign problem for full configuration interaction quantum Monte Carlo (FCIQMC), a stochastic algorithm for finding the ground-state solution of the Schr"odinger equation with substantially reduced computational cost compared with exact diagonalization. We find kkk-space Hubbard models for which the solution is yielded with storage that grows sublinearly in the size of the many-body Hilbert space, in spite of using a wave function that is simply a linear combination of states. The FCIQMC algorithm is able to find this sublinear scaling regime without bias and with only a choice of the Hamiltonian basis. By means of a demonstration we solve for the energy of a 70-site half-filled system (with a space of 1038{10}^{38}1038 determinants) in 250 core hours, substantially quicker than the \ensuremath∼1036\ensuremath{\sim}{10}^{36}\ensuremath∼1036 core hours that would be required by exact diagonalization. This is the largest space that has been sampled in an unbiased fashion. The challenge for the recently developed FCIQMC method is made clear: Expand the sublinear scaling regime while retaining exact-on-average accuracy. We comment upon the relationship between this and the scaling law previously observed in the initiator adaptation (i-FCIQMC). We argue that our results change the landscape for the development of FCIQMC and related methods.
There has been recent literature discussion on the origin and severity of the `sign problem' in full configuration interaction quantum Monte Carlo (FCIQMC) and its `initiator' adaptation (i-FCIQMC), methods of interest and potential because they allow for exact (FCI) ground-state solutions to be obtained often at a much reduced computational cost. In this study we aim to use a simple order parameter, describing the `sign structure' of the stochastic wavefunction representation, to empirically characterise the fundamentally different collective behaviour of the walker population in both methods.
To validate the ability of full configuration interaction quantum Monte Carlo (FCIQMC) for studying the 2D Hubbard model near half-filling regime, the ground state energies of a 4 × 4 square lattice system with various interaction strengths are calculated. It is found that the calculated results are in good agreement with those obtained by exact diagonalization (i.e., the exact values for a given basis set) when the population of psi particles (psips) is higher than the critical population required to correctly sample the ground state wave function. In addition, the variations of the average computational time per 20 Monte Carlo cycles with the coupling strength and the number of processors are also analyzed. The calculated results show that the computational efficiency of an FCIQMC calculation is mainly affected by the total population of psips and the communication between processors. These results can provide useful references for understanding the FCIQMC algorithm, studying the ground state properties of the 2D Hubbard model for the larger system size by the FCIQMC method and using a computational budget as effectively as possible.
We investigate the exact full configuration interaction quantum Monte Carlo algorithm (without the initiator approximation) applied to weak sign-problem fermionic systems, namely, systems in which the energy gap to the corresponding sign-free or “stoquastized” state is small. We show that the minimum number of walkers required to exactly overcome the sign problem can be significantly reduced via an importance-sampling similarity transformation even though the similarity-transformed Hamiltonian has the same stoquastic gap as the untransformed one. Furthermore, we show that in the off-half-filling Hubbard model at U/t = 8, the real-space (site) representation has a much weaker sign problem compared to the momentum space representation. By applying importance sampling using a Gutzwiller-like guiding wavefunction, we are able to substantially reduce the minimum number of walkers in the case of 2 × ℓ Hubbard ladders, enabling us to get exact energies for sizable ladders. With these results, we calculate the fundamental charge gap ΔEfund = E(N + 1) + E(N − 1) − 2E(N) for the ladder systems compared to strictly one-dimensional Hubbard chains and show that the ladder systems have a reduced fundamental gap compared to the 1D chains.
By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.
We expand upon the recent semi-stochastic adaptation to full configuration interaction quantum Monte Carlo (FCIQMC). We present an alternate method for generating the deterministic space without a priori knowledge of the wave function and present stochastic efficiencies for a variety of both molecular and lattice systems. The algorithmic details of an efficient semi-stochastic implementation are presented, with particular consideration given to the effect that the adaptation has on parallel performance in FCIQMC. We further demonstrate the benefit for calculation of reduced density matrices in FCIQMC through replica sampling, where the semi-stochastic adaptation seems to have even larger efficiency gains. We then combine these ideas to produce explicitly correlated corrected FCIQMC energies for the beryllium dimer, for which stochastic errors on the order of wavenumber accuracy are achievable.
Full configuration interaction quantum Monte Carlo for accurate ab initio\textit{ab initio}ab initio nuclear structure calculations: algorithms and calculation details
Full configuration interaction quantum Monte Carlo (FCIQMC) is a stochastic many-body solver that has been widely applied to electronic, molecular, and condensed-matter systems. In this work we apply FCIQMC to ab initio\textit{ab initio}ab initio nuclear structure calculations using interactions derived from chiral effective field theory. We describe the algorithm in detail, including imaginary-time propagation, excitation generation, estimator choices, the initiator approximation with adaptive shift correction, and reduced-density-matrix (RDM) sampling. Benchmark calculations in small model spaces, where deterministic full configuration interaction (FCI) results are available, validate the stochastic calculation of energies, radii, and RDM-based pure estimators. For large model spaces, we analyze the residual finite-walker bias through systematic walker-number convergence and infinite-walker extrapolations. We also demonstrate that FCIQMC can be extended beyond ground-state calculations by computing the low-lying spectrum of 6^66Li.