The combination of continuum many-body quantum physics and Monte Carlo methods provide a powerful and well established approach to first principles calculations for large systems. Replacing the exact solution of the problem with a statistical estimate requires a measure of the random error in the estimate for it to be useful. Such a measure of confidence is usually provided by assuming the central limit theorem to hold true. In what follows it is demonstrated that, for the most popular implementation of the variational Monte Carlo method, the central limit theorem has limited validity, or is invalid and must be replaced by a generalized central limit theorem. Estimates of the total energy and the variance of the local energy are examined in detail, and shown to exhibit uncontrolled statistical errors through an explicit derivation of the distribution of the random error. Several examples are given of estimated quantities for which the central limit theorem is not valid. The approach used is generally applicable to characterizing the random error of estimates, and to quantum Monte Carlo methods beyond variational Monte Carlo.
The combination of continuum many-body quantum physics and Monte Carlo methods provide a powerful and well established approach to first principles calculations for large systems. Replacing the exact solution of the problem with a statistical estimate requires a measure of the random error in the estimate for it to be useful. Such a measure of confidence is usually provided by assuming the central limit theorem to hold true. In what follows it is demonstrated that, for the most popular implementation of the variational Monte Carlo method, the central limit theorem has limited validity, or is invalid and must be replaced by a generalized central limit theorem. Estimates of the total energy and the variance of the local energy are examined in detail, and shown to exhibit uncontrolled statistical errors through an explicit derivation of the distribution of the random error. Several examples are given of estimated quantities for which the central limit theorem is not valid. The approach used is generally applicable to characterizing the random error of estimates, and to quantum Monte Carlo methods beyond variational Monte Carlo.
Expectation values of physical quantities may accurately be obtained by the evaluation of integrals within many-body quantum mechanics, and these multidimensional integrals may be estimated using Monte Carlo methods. In a previous publication it has been shown that for the simplest, most commonly applied strategy in continuum quantum Monte Carlo, the random error in the resulting estimates is not well controlled. At best the central limit theorem is valid in its weakest form, and at worst it is invalid and replaced by an alternative generalized central limit theorem and non-normal random error. In both cases the random error is not controlled. Here we consider a new "residual sampling strategy" that reintroduces the central limit theorem in its strongest form, and provides full control of the random error in estimates. Estimates of the total energy and the variance of the local energy within variational Monte Carlo are considered in detail, and the approach presented may be generalized to expectation values of other operators, and to other variants of the quantum Monte Carlo method.
Quantum mechanics for many-body systems may be reduced to the evaluation of integrals in 3N dimensions using Monte Carlo, providing the Quantum Monte Carlo ab initio methods. Here we limit ourselves to expectation values for trial wave functions, that is to variational quantum Monte Carlo. Almost all previous implementations employ samples distributed as the physical probability density of the trial wave function, and assume the central limit theorem to be valid. In this paper we provide an analysis of random error in estimation and optimization that leads naturally to new sampling strategies with improved computational and statistical properties. A rigorous lower limit to the random error is derived, and an efficient sampling strategy presented that significantly increases computational efficiency. In addition the infinite variance heavy tailed random errors of optimum parameters in conventional methods are replaced with a Normal random error, strengthening the theoretical basis of optimization. The method is applied to a number of first row systems and compared with previously published results.
A quantum Monte Carlo method is simply a Monte Carlo method applied to a quantum problem. What distinguishes a quantum Monte Carlo method from a classical one is the initial effort necessary to represent the quantum problem in a form that is suitable for Monte Carlo simulation. It is in making this transformation that the quantum nature of the problem asserts itself not only through such obvious issues as the noncommutivity of the physical variables and the need to symmetrize or antisymmetrize the wave function, but also through less obvious issues such as the sign problem. Almost always, the transformation replaces the quantum degrees of freedom by classical ones, and it is to these classical degrees of freedom that the Monte Carlo method is actually applied. Succeeding chapters present and explain many of the quantum Monte Carlo methods being successfully used on a variety of quantum problems. In Chapters 1 and 2 we focus on discussing what the Monte Carlo method is and why it is useful. The Monte Carlo method The Monte Carlo method is not a specific technique but a general strategy for solving problems too complex to solve analytically or too intensive numerically to solve deterministically. Often a specific strategy incorporates several different Monte Carlo techniques. In what is likely the first journal article to use the phrase “Monte Carlo,” Metropolis and Ulam (1949) discuss this strategy. To paraphrase them, The Monte Carlo method is an iterative stochastic procedure, consistent with a defining relation for some function, which allows an estimate of the function without completely determining it. This is quite different from the colloquialism, “a method that uses random numbers.” Let us examine the definition piece by piece. A key point will emerge. Ulam and Metropolis were presenting the motivation and a general description of a statistical approach to the study of differential and integro-differential equations. These equations were their “defining relation for some function.” The “function” was the solution of these equations. This function is of course unknown a priori. Metropolis, Rosenbluth, Rosenbluth, Teller, and Teller (1953) a few years later would propose a statistical approach to the study of equilibrium statistical mechanics. The defining relation there was a thermodynamic average of a physical quantity over the Boltzmann distribution. The function was the physical quantity, and the unknown its average.
Quantum Averages and Statistical Samplings In this chapter, we discuss the general framework in which the variational Monte Carlo methods are defined and few important implementations for interacting systems of bosons and fermions on the lattice. The main advantage of considering this approach relies on the variational principle that has been shown in section 1.4: the energy of a given quantum state is always bounded from below by the exact ground-state one, giving us the route to obtain the best possible solution to the problem. In most cases, a suitable parametrization of the variational wave function allows us to consider a wide range of different quantum phases (e.g., metals, superconductors, and insulators). By performing an optimization of the parameters, we can reach the lowest-energy state, which is expected to capture the correct ground-state behavior. Therefore, variational wave functions represent a flexible and valuable approach to get important insights into the low-energy properties of models that cannot be solved by exact methods. By contrast, the main limitation of this approach is the fact that it is based on a given Ansatz , which may contain a relevant bias that cannot be removed within the chosen parametrization. We also mention that variational wave functions can be easily defined and treated for a wide class of models, irrespective of the range of interactions and the dimension of the local (i.e., single-site) Hilbert space, which can be even infinite and does not need the use of an uncontrolled cutoff to work with a finite-dimensional space. In this respect, variational Monte Carlo is better than other methods, like densitymatrix renormalization group or tensor-network methods in which the complexity dramatically increases with both the range of the interaction and the dimension of the local Hilbert space (White, 1992; Schollwöck, 2005, 2011). Let us start by describing the general framework in which variational Monte Carlo methods are defined. First of all, we fix a complete basis set in the Hilbert space, in which (for simplicity) the states are taken to be orthogonal and normalized such that: Then, any quantum state can be written as: In turn, the expectation value of an operator over a given variational wave function takes the following form: The main problem in evaluating the expectation value is that the number of configurations in the sum is exponentially large with the number of particles.
Despite the proven utility of quantum Monte Carlo methods in addressing the quantum many-body problem, many important observables are difficult to calculate due to the presence of large, and sometimes divergent, statistical errors. The present state of the art allows the construction of renormalized estimators which result in finite variances, but which invariably include some systematic bias. We present a simple method for calculating unbiased expectation values of local operators in the diffusion quantum Monte Carlo method which is applicable to both bare and renormalized estimators, allowing the accurate calculation of important properties such as forces.