Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

International Journal of Modern Physics C

PROJECTION MONTE CARLO METHODS: AN ALGORITHMIC ANALYSIS

Nicolas J. Cerf, Olivier Martin

Published Oct 1, 1995• 9 citations
Publisher

Abstract

Projection methods such as Green's function and diffusion Monte Carlo are commonly used to calculate the leading eigenvalue and eigenvector of operators or large matrices. They thereby give access to ground state properties of quantum systems, and finite temperature properties of classical statistical mechanical systems having a transfer matrix. The basis of these approaches is a stochastic application of the power method in which a "projection" operator is applied iteratively. For the systematic errors to be small, the number of iterations must be large; however, in that limit, the statistical errors grow tremendously. We present an analytical study of the main variance reduction methods used for dealing with this problem. In particular, we discuss the consequences of guiding, replication, and population control on statistical and systematic errors.

DOI
10.1142/s0129183195000587

Related papers

Power methods

James E. Gubernatis, Naoki Kawashima, Philipp Werner

Quantum Monte Carlo versions of the power method for finding ground states come with different names, including the projector method, diffusion Monte Carlo, and Green's function Monte Carlo. These quantum Monte Carlo methods are primarily adoptions of methods developed for classical problems. We summarize the basics of deterministic power methods, detail key features of Monte Carlo power methods, and put these concepts into the context of quantum ground state calculations. We conclude the chapter by outlining power methods that allow the computation of a few excited states. In the computation of excited states, we encounter sign problems, which are discussed inmore detail in Chapter 11. Themethods and techniques of the present chapter are very general and most usefully applied to systems of Bosons and to systems of Fermions and quantum spins that do not suffer from a sign problem. Deterministic direct and inverse power methods The power method is over a century old. As a deterministic method, it originally was combined with the deflation technique (Meyer, 2000; Stewart, 2001b) as a method to compute all the eigenvalues and eigenvectors of small matrices. Today, its deterministic use is limited primarily to special applications involving very large, sparse matrices. Many of these applications are in the study of quantum lattice models as the corresponding Hamiltonian matrices are typically very sparse. In these applications, we can perhaps initially store in computer memory the relatively small number of nonzero matrix elements and all the vectors. Soon, because of what is undoubtedly the now familiar exponentially increasing number of basis states that determines the order of the Hamiltonian matrix and hence the size of our vectors, we reach the point where computer memory restrictions allow us to store only a few vectors and we need to compute the matrix elements on the fly. When we have problems for which we cannot even store all the components of one vector, the power method's expression as a Monte Carlo procedure is our only option. With it, we can compute a few of the extremal eigenvalues, that is, a few of the largest or smallest eigenvalues. The mathematical basis for the method is simple.

Cambridge University Press eBooks•Jan 31, 2016•0 citations

Finite population-size effects in projection Monte Carlo methods

Nicolas J. Cerf, Olivier Martin

Projection (Green's function and diffusion) MOnte Carlo techniques sample a wave function by a stochastic iterative procedure. These method converge to a stationary distribution which is biased, i.e., differs from the exact ground state wave function. This bias occurs because of the use of population control procedures. We demonstrate that these biased Monte Carlo algorithms lead to a modified effective mass which is equal to the desired mass only in the limit of an infinite population of walkers. In general, the bias for the energy scales as 1/N for a population of walkers of size N and is proportional to the expectation value of the kinetic energy. Finally, we consider various strategies to reduce this bias.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics•Apr 1, 1995•22 citations

Observations on the statistical iteration of matrices

J. H. Hetherington

Monte Carlo calculations which rely on the statistical iteration of some operator can sometimes lead to results in which the variance grows as the iterations proceed. Alternatively the variance can be stable but the result incorrect. The effects are demonstrated by the Monte Carlo iteration of a 2\ifmmode\times\else\texttimes\fi{} 2 matrix and analyzed in detail for this simple case. In addition an algebraic formulation of a full Monte Carlo calculation with many simultaneous configurations including a method for keeping the number of configurations constant is given. With this formulation it is shown that the naive sampling of the wave function and naive estimate of the eigenvalue based on the growth in the number of configurations will be stable but biased. It is made plausible that for a sufficiently large number ($M$) of simultaneous configurations the naive method leads to a result which approaches the correct one as $M\ensuremath{\rightarrow}\ensuremath{\infty}$. It is shown that the correct average eigenvalue and eigenvector is a certain weighted average defined so that it avoids the problem of the growing variance and thus becomes more accurate as the chain is extended.

Physical Review A•Nov 1, 1984•118 citations

Quantum Monte Carlo Developments For Discrete And Continuous Spaces

F. R. Petruzielo

This thesis details four research projects related to zero temperature quantum Monte Carlo. Chapters 2-4 focus on continuum quantum Monte Carlo, and specifically its application to molecular systems; whereas Chapter 5 focuses on quantum Monte Carlo in a discrete space. Chapter 2 focuses on improving upon the single-particle basis functions employed in quantum Monte Carlo calculations for molecular systems. For calculations requiring non-diverging pseudopotentials, a class of functions is introduced that is capable of producing the short- and long-range asymptotic behavior of the exact wavefunction. It is demonstrated that this form of basis function produces superior accuracy and efficiency when compared to the basis sets typically employed in quantum Monte Carlo. Although the basis functions introduced in Chapter 2 are capable of producing superior results, it is necessary that the parameters of the functional form are near-optimal for the full potential of the functions to be realized. Chapter 3 introduces a simple yet general method for constructing basis sets of a desired functional form appropriate for molecular electronic structure calculations. A standard basis set is created for each of the elements from hydrogen to argon. Chapter 4 explores the effect of different aspects of the trial wavefunction on the accuracy of quantum Monte Carlo. By systematically testing the effect of the basis size, orbital quality, and determinant expansion quality, this work offers guidance to quantum Monte Carlo practitioners for achieving results to within chemical accuracy of experiment. In Chapter 5, semistochastic projection, a hybrid of deterministic and stochastic projection, is introduced for finding the dominant eigenvalue and eigenvector of a matrix. This method, like stochastic projection, is applicable to matrices well beyond the size that can be handled by deterministic methods. Semistochastic projection improves over stochastic projection by significantly reducing the computational time required to obtain the eigenvalue within a specified statistical uncertainty. After the semistochastic projection method is introduced, it is applied to determine the ground state energy of the Hamiltonian in a discrete basis. This special case of semistochastic projection, dubbed semistochastic quantum Monte Carlo, is shown to be orders of magnitude more efficient than stochastic quantum Monte Carlo.

•May 27, 2012•0 citations

The calculation of excited state properties with quantum Monte Carlo

David M. Ceperley, B. Bernu

A new Monte Carlo method for computing excited state properties of quantum systems is introduced. It is a generalization of the transient estimate method used for fermion Green’s function Monte Carlo and of subspace projection methods used for computing eigenstates of matrices. The time dependent autocorrelation function of a vector of trial functions is calculated for a random walk generated by the imaginary-time Schrödinger equation and estimates of energy levels are determined by the eigenvalues of the matrix of correlation functions. This method is especially useful for treating states with the same symmetry as it automatically keeps higher states orthogonal to lower states. The estimated energy converges to the exact eigenvalue with a rate which decreases with increasing excitation energy, thus limiting the method to relatively low-lying states. The method is zero variance in the sense that as better trial functions are introduced, the statistical error decreases to zero. The method has a nontrivial bias which is analyzed. As an illustration, the eigenvalues of a double well are computed.

The Journal of Chemical Physics•Nov 15, 1988•151 citations

Projector quantum Monte Carlo

Richard M. Martin, Lucia Reining, David M. Ceperley

… as suggested by Fermi, the time-independent Schrödinger equation … can be interpreted as describing the behavior of a system of particles each of which performs a random walk, i.e., diffuses isotropically and at the same time is subject to multiplication, which is determined by the value of the point function V. N. Metropolis and S. Ulam, 1949 Summary In the projector quantum Monte Carlo method, one uses a function of the hamiltonian to sample a distribution proportional to the exact ground-state wavefunction, and thereby computes exact matrix elements of it. An importance sampling transformation makes the algorithm much more efficient. In this chapter we introduce and develop the diffusion Monte Carlo method, which involves drifting, branching random walks. For any excited state, including any system with more than two electrons, one encounters the sign problem, limiting the direct application of these algorithms for most fermion systems. Instead, by using approximate fixed-node or fixed-phase boundary conditions, one can achieve efficiency similar to variational Monte Carlo. We also discuss the application of the projector method in a basis of Slater determinants. In this chapter, we discuss a different quantum Monte Carlo method, projector Monte Carlo (PMC). This general method was first suggested by Fermi [1049]; see the quote at the start of this chapter by two of the inventors of the Monte Carlo method. An implementation of PMC was tried out in the early days of computing [1050]. Advances in methodology, in particular importance sampling, resulted in a significant large-scale application: the exact calculation of the ground-state properties of 256 hard-sphere bosons by Kalos, Levesque, and Verlet [1051] in 1974. Calculations for electronic systems and the fixednode approximation were introduced by Anderson [1052, 1053]. One of the most important projector MC algorithms, the diffusion Monte Carlo algorithm with importance sampling for fermions, was used to compute the correlation energy of homogeneous electron gas by Ceperley and Alder [109] in 1980; the resulting HEG correlation energy was crucial in the development of density functional calculations. Types and properties of projectors In this method, a many-body projector G ( R , R ) = Ĝ is repeatedly applied to filter out the exact many-body ground state from an initial state; the operation of the projector is carried out with a random walk, hence the name of this class of methods.

Cambridge University Press eBooks•May 31, 2016•0 citations
Projection methods such as Green's function and diffusion Monte Carlo are commonly used to calculate the leading eigenvalue and eigenvector of operators or large matrices. They thereby give access to ground state properties of quantum systems, and finite temperature properties of classical statistical mechanical systems having a transfer matrix. The basis of these approaches is a stochastic application of the power method in which a "projection" operator is applied iteratively. For the systematic errors to be small, the number of iterations must be large; however, in that limit, the statistical errors grow tremendously. We present an analytical study of the main variance reduction methods used for dealing with this problem. In particular, we discuss the consequences of guiding, replication, and population control on statistical and systematic errors.
Quantum Monte Carlo versions of the power method for finding ground states come with different names, including the projector method, diffusion Monte Carlo, and Green's function Monte Carlo. These quantum Monte Carlo methods are primarily adoptions of methods developed for classical problems. We summarize the basics of deterministic power methods, detail key features of Monte Carlo power methods, and put these concepts into the context of quantum ground state calculations. We conclude the chapter by outlining power methods that allow the computation of a few excited states. In the computation of excited states, we encounter sign problems, which are discussed inmore detail in Chapter 11. Themethods and techniques of the present chapter are very general and most usefully applied to systems of Bosons and to systems of Fermions and quantum spins that do not suffer from a sign problem. Deterministic direct and inverse power methods The power method is over a century old. As a deterministic method, it originally was combined with the deflation technique (Meyer, 2000; Stewart, 2001b) as a method to compute all the eigenvalues and eigenvectors of small matrices. Today, its deterministic use is limited primarily to special applications involving very large, sparse matrices. Many of these applications are in the study of quantum lattice models as the corresponding Hamiltonian matrices are typically very sparse. In these applications, we can perhaps initially store in computer memory the relatively small number of nonzero matrix elements and all the vectors. Soon, because of what is undoubtedly the now familiar exponentially increasing number of basis states that determines the order of the Hamiltonian matrix and hence the size of our vectors, we reach the point where computer memory restrictions allow us to store only a few vectors and we need to compute the matrix elements on the fly. When we have problems for which we cannot even store all the components of one vector, the power method's expression as a Monte Carlo procedure is our only option. With it, we can compute a few of the extremal eigenvalues, that is, a few of the largest or smallest eigenvalues. The mathematical basis for the method is simple.
Projection (Green's function and diffusion) MOnte Carlo techniques sample a wave function by a stochastic iterative procedure. These method converge to a stationary distribution which is biased, i.e., differs from the exact ground state wave function. This bias occurs because of the use of population control procedures. We demonstrate that these biased Monte Carlo algorithms lead to a modified effective mass which is equal to the desired mass only in the limit of an infinite population of walkers. In general, the bias for the energy scales as 1/N for a population of walkers of size N and is proportional to the expectation value of the kinetic energy. Finally, we consider various strategies to reduce this bias.
Monte Carlo calculations which rely on the statistical iteration of some operator can sometimes lead to results in which the variance grows as the iterations proceed. Alternatively the variance can be stable but the result incorrect. The effects are demonstrated by the Monte Carlo iteration of a 2\ifmmode\times\else\texttimes\fi{} 2 matrix and analyzed in detail for this simple case. In addition an algebraic formulation of a full Monte Carlo calculation with many simultaneous configurations including a method for keeping the number of configurations constant is given. With this formulation it is shown that the naive sampling of the wave function and naive estimate of the eigenvalue based on the growth in the number of configurations will be stable but biased. It is made plausible that for a sufficiently large number (MMM) of simultaneous configurations the naive method leads to a result which approaches the correct one as $M\ensuremath{\rightarrow}\ensuremath{\infty}$. It is shown that the correct average eigenvalue and eigenvector is a certain weighted average defined so that it avoids the problem of the growing variance and thus becomes more accurate as the chain is extended.
This thesis details four research projects related to zero temperature quantum Monte Carlo. Chapters 2-4 focus on continuum quantum Monte Carlo, and specifically its application to molecular systems; whereas Chapter 5 focuses on quantum Monte Carlo in a discrete space. Chapter 2 focuses on improving upon the single-particle basis functions employed in quantum Monte Carlo calculations for molecular systems. For calculations requiring non-diverging pseudopotentials, a class of functions is introduced that is capable of producing the short- and long-range asymptotic behavior of the exact wavefunction. It is demonstrated that this form of basis function produces superior accuracy and efficiency when compared to the basis sets typically employed in quantum Monte Carlo. Although the basis functions introduced in Chapter 2 are capable of producing superior results, it is necessary that the parameters of the functional form are near-optimal for the full potential of the functions to be realized. Chapter 3 introduces a simple yet general method for constructing basis sets of a desired functional form appropriate for molecular electronic structure calculations. A standard basis set is created for each of the elements from hydrogen to argon. Chapter 4 explores the effect of different aspects of the trial wavefunction on the accuracy of quantum Monte Carlo. By systematically testing the effect of the basis size, orbital quality, and determinant expansion quality, this work offers guidance to quantum Monte Carlo practitioners for achieving results to within chemical accuracy of experiment. In Chapter 5, semistochastic projection, a hybrid of deterministic and stochastic projection, is introduced for finding the dominant eigenvalue and eigenvector of a matrix. This method, like stochastic projection, is applicable to matrices well beyond the size that can be handled by deterministic methods. Semistochastic projection improves over stochastic projection by significantly reducing the computational time required to obtain the eigenvalue within a specified statistical uncertainty. After the semistochastic projection method is introduced, it is applied to determine the ground state energy of the Hamiltonian in a discrete basis. This special case of semistochastic projection, dubbed semistochastic quantum Monte Carlo, is shown to be orders of magnitude more efficient than stochastic quantum Monte Carlo.
A new Monte Carlo method for computing excited state properties of quantum systems is introduced. It is a generalization of the transient estimate method used for fermion Green’s function Monte Carlo and of subspace projection methods used for computing eigenstates of matrices. The time dependent autocorrelation function of a vector of trial functions is calculated for a random walk generated by the imaginary-time Schrödinger equation and estimates of energy levels are determined by the eigenvalues of the matrix of correlation functions. This method is especially useful for treating states with the same symmetry as it automatically keeps higher states orthogonal to lower states. The estimated energy converges to the exact eigenvalue with a rate which decreases with increasing excitation energy, thus limiting the method to relatively low-lying states. The method is zero variance in the sense that as better trial functions are introduced, the statistical error decreases to zero. The method has a nontrivial bias which is analyzed. As an illustration, the eigenvalues of a double well are computed.
… as suggested by Fermi, the time-independent Schrödinger equation … can be interpreted as describing the behavior of a system of particles each of which performs a random walk, i.e., diffuses isotropically and at the same time is subject to multiplication, which is determined by the value of the point function V. N. Metropolis and S. Ulam, 1949 Summary In the projector quantum Monte Carlo method, one uses a function of the hamiltonian to sample a distribution proportional to the exact ground-state wavefunction, and thereby computes exact matrix elements of it. An importance sampling transformation makes the algorithm much more efficient. In this chapter we introduce and develop the diffusion Monte Carlo method, which involves drifting, branching random walks. For any excited state, including any system with more than two electrons, one encounters the sign problem, limiting the direct application of these algorithms for most fermion systems. Instead, by using approximate fixed-node or fixed-phase boundary conditions, one can achieve efficiency similar to variational Monte Carlo. We also discuss the application of the projector method in a basis of Slater determinants. In this chapter, we discuss a different quantum Monte Carlo method, projector Monte Carlo (PMC). This general method was first suggested by Fermi [1049]; see the quote at the start of this chapter by two of the inventors of the Monte Carlo method. An implementation of PMC was tried out in the early days of computing [1050]. Advances in methodology, in particular importance sampling, resulted in a significant large-scale application: the exact calculation of the ground-state properties of 256 hard-sphere bosons by Kalos, Levesque, and Verlet [1051] in 1974. Calculations for electronic systems and the fixednode approximation were introduced by Anderson [1052, 1053]. One of the most important projector MC algorithms, the diffusion Monte Carlo algorithm with importance sampling for fermions, was used to compute the correlation energy of homogeneous electron gas by Ceperley and Alder [109] in 1980; the resulting HEG correlation energy was crucial in the development of density functional calculations. Types and properties of projectors In this method, a many-body projector G ( R , R ) = Ĝ is repeatedly applied to filter out the exact many-body ground state from an initial state; the operation of the projector is carried out with a random walk, hence the name of this class of methods.