Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1904.10087 · Physical Chemistry Chemical Physics

Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo

Leon Otis, Eric Neuscamman

Published Jan 1, 2019• 25 citations
arXivHTMLPDF

Abstract

We present a comparison between a number of recently introduced low-memory wave function optimization methods for variational Monte Carlo in which we find that first and second derivative methods possess strongly complementary relative advantages. While we find that low-memory variants of the linear method are vastly more efficient at bringing wave functions with disparate types of nonlinear parameters to the vicinity of the energy minimum, accelerated descent approaches are then able to locate the precise minimum with less bias and lower statistical uncertainty. By constructing a simple hybrid approach that combines these methodologies, we show that all of these advantages can be had at once when simultaneously optimizing large determinant expansions, molecular orbital shapes, traditional Jastrow correlation factors, and more nonlinear many-electron Jastrow factors.

DOI
10.1039/c9cp02269d

Related papers

Optimization of quantum Monte Carlo wave functions by energy minimization

Julien Toulouse, Cyrus J. Umrigar

We study three wave function optimization methods based on energy minimization in a variational Monte Carlo framework: the Newton, linear, and perturbative methods. In the Newton method, the parameter variations are calculated from the energy gradient and Hessian, using a reduced variance statistical estimator for the latter. In the linear method, the parameter variations are found by diagonalizing a nonsymmetric estimator of the Hamiltonian matrix in the space spanned by the wave function and its derivatives with respect to the parameters, making use of a strong zero-variance principle. In the less computationally expensive perturbative method, the parameter variations are calculated by approximately solving the generalized eigenvalue equation of the linear method by a nonorthogonal perturbation theory. These general methods are illustrated here by the optimization of wave functions consisting of a Jastrow factor multiplied by an expansion in configuration state functions (CSFs) for the C2 molecule, including both valence and core electrons in the calculation. The Newton and linear methods are very efficient for the optimization of the Jastrow, CSF, and orbital parameters. The perturbative method is a good alternative for the optimization of just the CSF and orbital parameters. Although the optimization is performed at the variational Monte Carlo level, we observe for the C2 molecule studied here, and for other systems we have studied, that as more parameters in the trial wave functions are optimized, the diffusion Monte Carlo total energy improves monotonically, implying that the nodal hypersurface also improves monotonically.

arXiv:physics/0701039•The Journal of Chemical Physics•Feb 22, 2007•290 citations

Wave function optimization in the variational Monte Carlo method

Sandro Sorella

An appropriate iterative scheme for the minimization of the energy, based on the variational Monte Carlo (VMC) technique, is introduced and compared with existing stochastic schemes. We test the various methods for the one-dimensional Heisenberg ring and the two-dimensional $t\text{\ensuremath{-}}J$ model and show that, with the present scheme, very accurate and efficient calculations are possible, even for several variational parameters. Indeed, by using a very efficient statistical evaluation of the first and the second energy derivatives, it is possible to define a very rapidly converging iterative scheme that, within VMC, is much more convenient than the standard Newton method. It is also shown how to optimize simultaneously both the Jastrow and the determinantal part of the wave function.

arXiv:cond-mat/0502553•Physical Review B•Jun 22, 2005•266 citations

An accelerated linear method for optimizing non-linear wavefunctions in variational Monte Carlo

Iliya Sabzevari, Ankit Mahajan, Sandeep Sharma

Although the linear method is one of the most robust algorithms for optimizing nonlinearly parametrized wavefunctions in variational Monte Carlo, it suffers from a memory bottleneck due to the fact that at each optimization step, a generalized eigenvalue problem is solved in which the Hamiltonian and overlap matrices are stored in memory. Here, we demonstrate that by applying the Jacobi-Davidson algorithm, one can solve the generalized eigenvalue problem iteratively without having to build and store the matrices in question. The resulting direct linear method greatly lowers the cost and improves the scaling of the algorithm with respect to the number of parameters. To further improve the efficiency of optimization for wavefunctions with a large number of parameters, we use the first order method AMSGrad far from the minimum as it is very inexpensive and only switch to the direct linear method near the end of the optimization where methods such as AMSGrad have long convergence tails. We apply this improved optimizer to wavefunctions with real and orbital space Jastrow factors applied to a symmetry-projected generalized Hartree-Fock reference. Systems addressed include atomic systems such as beryllium and neon, molecular systems such as the carbon dimer and iron(ii) porphyrin, and model systems such as the Hubbard model and hydrogen chains.

arXiv:1908.04423•The Journal of Chemical Physics•Jan 10, 2020•20 citations

Improved wave function for strongly correlated electronic systems

Kenji Kobayashi, Kaoru Iguchi

A scheme of optimization of a trial wave function in the variational Monte Carlo calculation is developed. It provides a more precise description of the ground state for strongly correlated electronic systems with highly improved trial wave function. A general type of variational wave function constructed from a linear combination of Slater determinants multiplied by Jastrow correlation factors is proposed. They can explicitly contain low-energy fluctuations and long-range correlations. Using this optimization method, we examine the properties of these wave functions by applying them to a one-dimensional Hubbard model for which the exact solution is available for comparison. It is found that these wave functions prove to be substantial improvements compared to the conventional Jastrow-type wave functions.

Physical review. B, Condensed matter•Jan 15, 1993•14 citations

A Blocked Linear Method for Optimizing Large Parameter Sets in Variational Monte Carlo

Luning Zhao, Eric Neuscamman

We present a modification to variational Monte Carlo's linear method optimization scheme that addresses a critical memory bottleneck while maintaining compatibility with both the traditional ground state variational principle and our recently introduced variational principle for excited states. For wave function ansatzes with tens of thousands of variables, our modification reduces the required memory per parallel process from tens of gigabytes to hundreds of megabytes, making the methodology a much better fit for modern supercomputer architectures in which data communication and per-process memory consumption are primary concerns. We verify the efficacy of the new optimization scheme in small molecule tests involving both the Hilbert space Jastrow antisymmetric geminal power ansatz and real space multi-Slater Jastrow expansions. Satisfied with its performance, we have added the optimizer to the QMCPACK software package, with which we test a systematically convergent, nonperturbative approach to excitation energies on the example of a Mott-insulating hydrogen ring.

arXiv:1702.01481•Journal of Chemical Theory and Computation•May 17, 2017•26 citations

Variational Monte Carlo Method Combined with Quantum-Number Projection and Multi-Variable Optimization

Daisuke Tahara, Masatoshi Imada

Variational wave functions used in the variational Monte Carlo (VMC) method are extensively improved to overcome the biases coming from the assumed variational form of the wave functions. We construct a highly generalized variational form by introducing a large number of variational parameters to the Gutzwiller-Jastrow factor as well as to the one-body part. Moreover, the projection operator to restore the symmetry of the wave function is introduced. These improvements enable to treat fluctuations with long-ranged as well as short-ranged correlations. A highly generalized wave function is implemented by the Pfaffians introduced by Bouchaud et al., together with the stochastic reconfiguration method introduced by Sorella for the parameter optimization. Our framework offers much higher accuracy for strongly correlated electron systems than the conventional variational Monte Carlo methods.

arXiv:0805.4457•Journal of the Physical Society of Japan•Oct 27, 2008•147 citations
We present a comparison between a number of recently introduced low-memory wave function optimization methods for variational Monte Carlo in which we find that first and second derivative methods possess strongly complementary relative advantages. While we find that low-memory variants of the linear method are vastly more efficient at bringing wave functions with disparate types of nonlinear parameters to the vicinity of the energy minimum, accelerated descent approaches are then able to locate the precise minimum with less bias and lower statistical uncertainty. By constructing a simple hybrid approach that combines these methodologies, we show that all of these advantages can be had at once when simultaneously optimizing large determinant expansions, molecular orbital shapes, traditional Jastrow correlation factors, and more nonlinear many-electron Jastrow factors.
We study three wave function optimization methods based on energy minimization in a variational Monte Carlo framework: the Newton, linear, and perturbative methods. In the Newton method, the parameter variations are calculated from the energy gradient and Hessian, using a reduced variance statistical estimator for the latter. In the linear method, the parameter variations are found by diagonalizing a nonsymmetric estimator of the Hamiltonian matrix in the space spanned by the wave function and its derivatives with respect to the parameters, making use of a strong zero-variance principle. In the less computationally expensive perturbative method, the parameter variations are calculated by approximately solving the generalized eigenvalue equation of the linear method by a nonorthogonal perturbation theory. These general methods are illustrated here by the optimization of wave functions consisting of a Jastrow factor multiplied by an expansion in configuration state functions (CSFs) for the C2 molecule, including both valence and core electrons in the calculation. The Newton and linear methods are very efficient for the optimization of the Jastrow, CSF, and orbital parameters. The perturbative method is a good alternative for the optimization of just the CSF and orbital parameters. Although the optimization is performed at the variational Monte Carlo level, we observe for the C2 molecule studied here, and for other systems we have studied, that as more parameters in the trial wave functions are optimized, the diffusion Monte Carlo total energy improves monotonically, implying that the nodal hypersurface also improves monotonically.
An appropriate iterative scheme for the minimization of the energy, based on the variational Monte Carlo (VMC) technique, is introduced and compared with existing stochastic schemes. We test the various methods for the one-dimensional Heisenberg ring and the two-dimensional $t\text{\ensuremath{-}}J$ model and show that, with the present scheme, very accurate and efficient calculations are possible, even for several variational parameters. Indeed, by using a very efficient statistical evaluation of the first and the second energy derivatives, it is possible to define a very rapidly converging iterative scheme that, within VMC, is much more convenient than the standard Newton method. It is also shown how to optimize simultaneously both the Jastrow and the determinantal part of the wave function.
Although the linear method is one of the most robust algorithms for optimizing nonlinearly parametrized wavefunctions in variational Monte Carlo, it suffers from a memory bottleneck due to the fact that at each optimization step, a generalized eigenvalue problem is solved in which the Hamiltonian and overlap matrices are stored in memory. Here, we demonstrate that by applying the Jacobi-Davidson algorithm, one can solve the generalized eigenvalue problem iteratively without having to build and store the matrices in question. The resulting direct linear method greatly lowers the cost and improves the scaling of the algorithm with respect to the number of parameters. To further improve the efficiency of optimization for wavefunctions with a large number of parameters, we use the first order method AMSGrad far from the minimum as it is very inexpensive and only switch to the direct linear method near the end of the optimization where methods such as AMSGrad have long convergence tails. We apply this improved optimizer to wavefunctions with real and orbital space Jastrow factors applied to a symmetry-projected generalized Hartree-Fock reference. Systems addressed include atomic systems such as beryllium and neon, molecular systems such as the carbon dimer and iron(ii) porphyrin, and model systems such as the Hubbard model and hydrogen chains.
A scheme of optimization of a trial wave function in the variational Monte Carlo calculation is developed. It provides a more precise description of the ground state for strongly correlated electronic systems with highly improved trial wave function. A general type of variational wave function constructed from a linear combination of Slater determinants multiplied by Jastrow correlation factors is proposed. They can explicitly contain low-energy fluctuations and long-range correlations. Using this optimization method, we examine the properties of these wave functions by applying them to a one-dimensional Hubbard model for which the exact solution is available for comparison. It is found that these wave functions prove to be substantial improvements compared to the conventional Jastrow-type wave functions.
We present a modification to variational Monte Carlo's linear method optimization scheme that addresses a critical memory bottleneck while maintaining compatibility with both the traditional ground state variational principle and our recently introduced variational principle for excited states. For wave function ansatzes with tens of thousands of variables, our modification reduces the required memory per parallel process from tens of gigabytes to hundreds of megabytes, making the methodology a much better fit for modern supercomputer architectures in which data communication and per-process memory consumption are primary concerns. We verify the efficacy of the new optimization scheme in small molecule tests involving both the Hilbert space Jastrow antisymmetric geminal power ansatz and real space multi-Slater Jastrow expansions. Satisfied with its performance, we have added the optimizer to the QMCPACK software package, with which we test a systematically convergent, nonperturbative approach to excitation energies on the example of a Mott-insulating hydrogen ring.
Variational wave functions used in the variational Monte Carlo (VMC) method are extensively improved to overcome the biases coming from the assumed variational form of the wave functions. We construct a highly generalized variational form by introducing a large number of variational parameters to the Gutzwiller-Jastrow factor as well as to the one-body part. Moreover, the projection operator to restore the symmetry of the wave function is introduced. These improvements enable to treat fluctuations with long-ranged as well as short-ranged correlations. A highly generalized wave function is implemented by the Pfaffians introduced by Bouchaud et al., together with the stochastic reconfiguration method introduced by Sorella for the parameter optimization. Our framework offers much higher accuracy for strongly correlated electron systems than the conventional variational Monte Carlo methods.