Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Histogram filtering as a tool in variational Monte Carlo optimization

Martin. Å najdr

Published Jul 9, 1999• 0 citations
OpenAlex

Abstract

Optimization of wave functions in quantum Monte Carlo is a difficult task because the statistical uncertainty inherent to the technique makes the absolute determination of the global minimum difficult. To optimize these wave functions we generate a large number of possible minima using many independently generated Monte Carlo ensembles and perform a conjugate gradient optimization. Then we construct histograms of the resulting nominally optimal parameter sets and "filter" them to identify which parameter sets "go together" to generate a local minimum. We follow with correlated-sampling verification runs to find the global minimum. We illustrate this technique for variance and variational energy optimization for a variety of wave functions for small systellls. For such optimized wave functions we calculate the variational energy and variance as well as various non-differential properties. The optimizations are either on par with or superior to determinations in the literature. Furthermore, we show that this technique is sufficiently robust that for molecules one may determine the optimal geometry at tIle same time as one optimizes the variational energy.

Related papers

Optimization of quantum Monte Carlo wave functions by energy minimization

Julien Toulouse, Cyrus J. Umrigar

We study three wave function optimization methods based on energy minimization in a variational Monte Carlo framework: the Newton, linear, and perturbative methods. In the Newton method, the parameter variations are calculated from the energy gradient and Hessian, using a reduced variance statistical estimator for the latter. In the linear method, the parameter variations are found by diagonalizing a nonsymmetric estimator of the Hamiltonian matrix in the space spanned by the wave function and its derivatives with respect to the parameters, making use of a strong zero-variance principle. In the less computationally expensive perturbative method, the parameter variations are calculated by approximately solving the generalized eigenvalue equation of the linear method by a nonorthogonal perturbation theory. These general methods are illustrated here by the optimization of wave functions consisting of a Jastrow factor multiplied by an expansion in configuration state functions (CSFs) for the C2 molecule, including both valence and core electrons in the calculation. The Newton and linear methods are very efficient for the optimization of the Jastrow, CSF, and orbital parameters. The perturbative method is a good alternative for the optimization of just the CSF and orbital parameters. Although the optimization is performed at the variational Monte Carlo level, we observe for the C2 molecule studied here, and for other systems we have studied, that as more parameters in the trial wave functions are optimized, the diffusion Monte Carlo total energy improves monotonically, implying that the nodal hypersurface also improves monotonically.

arXiv:physics/0701039•The Journal of Chemical Physics•Feb 22, 2007•290 citations

Monte Carlo energy and variance-minimization techniques for optimizing many-body wave functions

Paul R. C. Kent, Richard J. Needs, Gunaretnam Rajagopal

We investigate Monte Carlo energy and variance-minimization techniques for optimizing many-body wave functions. Several variants of the basic techniques are studied, including limiting the variations in the weighting factors that arise in correlated sampling estimations of the energy and its variance. We investigate the numerical stability of the techniques and identify two reasons why variance minimization exhibits superior numerical stability to energy minimization. The characteristics of each method are studied using a noninteracting 64-electron model of crystalline silicon. While our main interest is in solid-state systems, the issues investigated are relevant to Monte Carlo studies of atoms, molecules, and solids. We identify a robust and efficient variance-minimization scheme for optimizing wave functions for large systems.

arXiv:cond-mat/9902300•Physical review. B, Condensed matter•May 15, 1999•109 citations

Ensemble variational Monte Carlo for optimization of correlated excited state wave functions

William A Wheeler, Kevin G. Kleiner, Lucas K. Wagner

Abstract Variational Monte Carlo methods have recently been applied to the calculation of excited states; however, it is still an open question what objective function is most effective. A promising approach is to optimize excited states using a penalty to minimize overlap with lower eigenstates, which has the drawback that states must be computed one at a time. We derive a general framework for constructing objective functions with minima at the the lowest N eigenstates of a many-body Hamiltonian. The objective function uses a weighted average of the energies and an overlap penalty, which must satisfy several conditions. We show this objective function has a minimum at the exact eigenstates for a finite penalty, and provide a few strategies to minimize the objective function. The method is demonstrated using ab initio variational Monte Carlo to calculate the degenerate first excited state of a CO molecule.

arXiv:2312.00693•Electronic Structure•Mar 28, 2024•9 citations

Wave function optimization in the variational Monte Carlo method

Sandro Sorella

An appropriate iterative scheme for the minimization of the energy, based on the variational Monte Carlo (VMC) technique, is introduced and compared with existing stochastic schemes. We test the various methods for the one-dimensional Heisenberg ring and the two-dimensional $t\text{\ensuremath{-}}J$ model and show that, with the present scheme, very accurate and efficient calculations are possible, even for several variational parameters. Indeed, by using a very efficient statistical evaluation of the first and the second energy derivatives, it is possible to define a very rapidly converging iterative scheme that, within VMC, is much more convenient than the standard Newton method. It is also shown how to optimize simultaneously both the Jastrow and the determinantal part of the wave function.

arXiv:cond-mat/0502553•Physical Review B•Jun 22, 2005•266 citations

Variance minimization for variational quantum Monte Carlo method

HX Huang, ZX Cao, Shubin Liu +1 more

A new algorithm for the variational quantum Monte Carlo (VMC) is proposed. This algorithm takesthe internal structure of a local energy as starting point, and directly reduces its fluctuation, making the variance decrease to the minimum. An analytical expression of the local energy is presented. The principle of variance minimization for the VMC is deduced, and the steps of variance minimization are established. This new algorithm was used to compute the energies of the ground states for molecules H2, LiH, Li2 and H2O. The Calculated results show that this novel algorithm is superior to the usual VMC in both accuracy and statistical error, with but very little increase in computational cost.

Progress in Natural Science Materials International•Oct 1, 1997•0 citations

Variational Principles in Quantum Monte Carlo: The Troubled Story of Variance Minimization

Alice Cuzzocrea, Anthony Scemama, Wim J. Briels +2 more

We investigate the use of different variational principles in quantum Monte Carlo, namely, energy and variance minimization, prompted by the interest in the robust and accurate estimation of electronic excited states. For two prototypical, challenging molecules, we readily reach the accuracy of the best available reference excitation energies using energy minimization in a state-specific or state-average fashion for states of different or equal symmetry, respectively. On the other hand, in variance minimization, where the use of suitable functionals is expected to target specific states regardless of the symmetry, we encounter severe problems for a variety of wave functions: as the variance converges, the energy drifts away from that of the selected state. This unexpected behavior is sometimes observed even when the target is the ground state and generally prevents the robust estimation of total and excitation energies. We analyze this problem using a very simple wave function and infer that the optimization finds little or no barrier to escape from a local minimum or local plateau, eventually converging to a lower-variance state instead of the target state. For the increasingly complex systems becoming in reach of quantum Monte Carlo simulations, variance minimization with current functionals appears to be an impractical route.

arXiv:2002.05951•Journal of Chemical Theory and Computation•May 17, 2020•38 citations
Optimization of wave functions in quantum Monte Carlo is a difficult task because the statistical uncertainty inherent to the technique makes the absolute determination of the global minimum difficult. To optimize these wave functions we generate a large number of possible minima using many independently generated Monte Carlo ensembles and perform a conjugate gradient optimization. Then we construct histograms of the resulting nominally optimal parameter sets and "filter" them to identify which parameter sets "go together" to generate a local minimum. We follow with correlated-sampling verification runs to find the global minimum. We illustrate this technique for variance and variational energy optimization for a variety of wave functions for small systellls. For such optimized wave functions we calculate the variational energy and variance as well as various non-differential properties. The optimizations are either on par with or superior to determinations in the literature. Furthermore, we show that this technique is sufficiently robust that for molecules one may determine the optimal geometry at tIle same time as one optimizes the variational energy.
We study three wave function optimization methods based on energy minimization in a variational Monte Carlo framework: the Newton, linear, and perturbative methods. In the Newton method, the parameter variations are calculated from the energy gradient and Hessian, using a reduced variance statistical estimator for the latter. In the linear method, the parameter variations are found by diagonalizing a nonsymmetric estimator of the Hamiltonian matrix in the space spanned by the wave function and its derivatives with respect to the parameters, making use of a strong zero-variance principle. In the less computationally expensive perturbative method, the parameter variations are calculated by approximately solving the generalized eigenvalue equation of the linear method by a nonorthogonal perturbation theory. These general methods are illustrated here by the optimization of wave functions consisting of a Jastrow factor multiplied by an expansion in configuration state functions (CSFs) for the C2 molecule, including both valence and core electrons in the calculation. The Newton and linear methods are very efficient for the optimization of the Jastrow, CSF, and orbital parameters. The perturbative method is a good alternative for the optimization of just the CSF and orbital parameters. Although the optimization is performed at the variational Monte Carlo level, we observe for the C2 molecule studied here, and for other systems we have studied, that as more parameters in the trial wave functions are optimized, the diffusion Monte Carlo total energy improves monotonically, implying that the nodal hypersurface also improves monotonically.
We investigate Monte Carlo energy and variance-minimization techniques for optimizing many-body wave functions. Several variants of the basic techniques are studied, including limiting the variations in the weighting factors that arise in correlated sampling estimations of the energy and its variance. We investigate the numerical stability of the techniques and identify two reasons why variance minimization exhibits superior numerical stability to energy minimization. The characteristics of each method are studied using a noninteracting 64-electron model of crystalline silicon. While our main interest is in solid-state systems, the issues investigated are relevant to Monte Carlo studies of atoms, molecules, and solids. We identify a robust and efficient variance-minimization scheme for optimizing wave functions for large systems.
Abstract Variational Monte Carlo methods have recently been applied to the calculation of excited states; however, it is still an open question what objective function is most effective. A promising approach is to optimize excited states using a penalty to minimize overlap with lower eigenstates, which has the drawback that states must be computed one at a time. We derive a general framework for constructing objective functions with minima at the the lowest N eigenstates of a many-body Hamiltonian. The objective function uses a weighted average of the energies and an overlap penalty, which must satisfy several conditions. We show this objective function has a minimum at the exact eigenstates for a finite penalty, and provide a few strategies to minimize the objective function. The method is demonstrated using ab initio variational Monte Carlo to calculate the degenerate first excited state of a CO molecule.
An appropriate iterative scheme for the minimization of the energy, based on the variational Monte Carlo (VMC) technique, is introduced and compared with existing stochastic schemes. We test the various methods for the one-dimensional Heisenberg ring and the two-dimensional $t\text{\ensuremath{-}}J$ model and show that, with the present scheme, very accurate and efficient calculations are possible, even for several variational parameters. Indeed, by using a very efficient statistical evaluation of the first and the second energy derivatives, it is possible to define a very rapidly converging iterative scheme that, within VMC, is much more convenient than the standard Newton method. It is also shown how to optimize simultaneously both the Jastrow and the determinantal part of the wave function.
A new algorithm for the variational quantum Monte Carlo (VMC) is proposed. This algorithm takesthe internal structure of a local energy as starting point, and directly reduces its fluctuation, making the variance decrease to the minimum. An analytical expression of the local energy is presented. The principle of variance minimization for the VMC is deduced, and the steps of variance minimization are established. This new algorithm was used to compute the energies of the ground states for molecules H2, LiH, Li2 and H2O. The Calculated results show that this novel algorithm is superior to the usual VMC in both accuracy and statistical error, with but very little increase in computational cost.
We investigate the use of different variational principles in quantum Monte Carlo, namely, energy and variance minimization, prompted by the interest in the robust and accurate estimation of electronic excited states. For two prototypical, challenging molecules, we readily reach the accuracy of the best available reference excitation energies using energy minimization in a state-specific or state-average fashion for states of different or equal symmetry, respectively. On the other hand, in variance minimization, where the use of suitable functionals is expected to target specific states regardless of the symmetry, we encounter severe problems for a variety of wave functions: as the variance converges, the energy drifts away from that of the selected state. This unexpected behavior is sometimes observed even when the target is the ground state and generally prevents the robust estimation of total and excitation energies. We analyze this problem using a very simple wave function and infer that the optimization finds little or no barrier to escape from a local minimum or local plateau, eventually converging to a lower-variance state instead of the target state. For the increasingly complex systems becoming in reach of quantum Monte Carlo simulations, variance minimization with current functionals appears to be an impractical route.