Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2010.09813 · The Journal of Chemical Physics

Finite temperature auxiliary field quantum Monte Carlo in the canonical ensemble

Tong Shen, Yuan Liu, Yang Yu, Brenda M. Rubenstein

Published Nov 25, 2020• 32 citations
arXivHTMLPDF

Abstract

Finite temperature auxiliary field-based quantum Monte Carlo methods, including determinant quantum Monte Carlo and Auxiliary Field Quantum Monte Carlo (AFQMC), have historically assumed pivotal roles in the investigation of the finite temperature phase diagrams of a wide variety of multidimensional lattice models and materials. Despite their utility, however, these techniques are typically formulated in the grand canonical ensemble, which makes them difficult to apply to condensates such as superfluids and difficult to benchmark against alternative methods that are formulated in the canonical ensemble. Working in the grand canonical ensemble is furthermore accompanied by the increased overhead associated with having to determine the chemical potentials that produce desired fillings. Given this backdrop, in this work, we present a new recursive approach for performing AFQMC simulations in the canonical ensemble that does not require knowledge of chemical potentials. To derive this approach, we exploit the convenient fact that AFQMC solves the many-body problem by decoupling many-body propagators into integrals over one-body problems to which non-interacting theories can be applied. We benchmark the accuracy of our technique on illustrative Bose and Fermi-Hubbard models and demonstrate that it can converge more quickly to the ground state than grand canonical AFQMC simulations. We believe that our novel use of HS-transformed operators to implement algorithms originally derived for non-interacting systems will motivate the development of a variety of other methods and anticipate that our technique will enable direct performance comparisons against other many-body approaches formulated in the canonical ensemble.

DOI
10.1063/5.0026606

Related papers

Stable recursive auxiliary field quantum Monte Carlo algorithm in the canonical ensemble: Applications to thermometry and the Hubbard model

Tong Shen, Hatem Barghathi, Jiangyong Yu +2 more

Many experimentally accessible, finite-sized interacting quantum systems are most appropriately described by the canonical ensemble of statistical mechanics. Conventional numerical simulation methods either approximate them as being coupled to a particle bath or use projective algorithms which may suffer from nonoptimal scaling with system size or large algorithmic prefactors. In this paper, we introduce a highly stable, recursive auxiliary field quantum Monte Carlo approach that can directly simulate systems in the canonical ensemble. We apply the method to the fermion Hubbard model in one and two spatial dimensions in a regime known to exhibit a significant "sign" problem and find improved performance over existing approaches including rapid convergence to ground-state expectation values. The effects of excitations above the ground state are quantified using an estimator-agnostic approach including studying the temperature dependence of the purity and overlap fidelity of the canonical and grand canonical density matrices. As an important application, we show that thermometry approaches often exploited in ultracold atoms that employ an analysis of the velocity distribution in the grand canonical ensemble may be subject to errors leading to an underestimation of extracted temperatures with respect to the Fermi temperature.

arXiv:2212.08654•Physical review. E•May 9, 2023•9 citations

Finite-temperature auxiliary-field quantum Monte Carlo technique for Bose-Fermi mixtures

Brenda M. Rubenstein, Shiwei Zhang, David R. Reichman

We present a quantum Monte Carlo (QMC) technique for calculating the exact finite-temperature properties of Bose-Fermi mixtures. The Bose-Fermi auxiliary-field quantum Monte Carlo (BFAFQMC) algorithm combines two methods, a finite-temperature AFQMC algorithm for bosons and a variant of the standard AFQMC algorithm for fermions, into one algorithm for mixtures. We demonstrate the accuracy of our method by comparing its results for the Bose-Hubbard and Bose-Fermi-Hubbard models against those produced using exact diagonalization for small systems. Comparisons are also made with mean-field theory and the worm algorithm for larger systems. As is the case with most fermion Hamiltonians, a sign or phase problem is present in the BFAFQMC algorithm. We discuss the nature of these problems in this framework and describe how they can be controlled with well-studied approximations to expand the BFAFQMC algorithm's reach. This algorithm can serve as an essential tool for answering many unresolved questions about many-body physics in mixed Bose-Fermi systems.

arXiv:1209.0186•Physical Review A•Nov 8, 2012•32 citations

Ab Initio Finite Temperature Auxiliary Field Quantum Monte Carlo

Yuan Liu, Minsik Cho, Brenda M. Rubenstein

We present an ab initio auxiliary field quantum Monte Carlo method for studying the electronic structure of molecules, solids, and model Hamiltonians at finite temperature. The algorithm marries the ab initio phaseless auxiliary field quantum Monte Carlo algorithm known to produce high accuracy ground state energies of molecules and solids with its finite temperature variant, long used by condensed matter physicists for studying model Hamiltonian phase diagrams, to yield a phaseless, ab initio finite temperature method. We demonstrate that the method produces internal energies within chemical accuracy of exact diagonalization results across a wide range of temperatures for H 2 O (STO-3G), C 2 (STO-6G), the one-dimensional hydrogen chain (STO-6G), and the multiorbital Hubbard model. Our method effectively controls the phase problem through importance sampling, often even without invoking the phaseless approximation, down to temperatures at which the systems studied approach their ground states and may therefore be viewed as exact over wide temperature ranges. This technique embodies a versatile tool for studying the finite temperature phase diagrams of a plethora of systems whose properties cannot be captured by a Hubbard U term alone. Our results moreover illustrate that the severity of the phase problem for model Hamiltonians far exceeds that for many molecules at all of the temperatures studied.

arXiv:1806.02848•Journal of Chemical Theory and Computation•Aug 13, 2018•51 citations

Some recent developments in auxiliary-field quantum Monte Carlo for real materials

Hao Shi, Shiwei Zhang

The auxiliary-field quantum Monte Carlo (AFQMC) method is a general numerical method for correlated many-electron systems, which is being increasingly applied in lattice models, atoms, molecules, and solids. Here, we introduce the theory and algorithm of the method specialized for real materials and present several recent developments. We give a systematic exposition of the key steps of AFQMC, closely tracking the framework of a modern software library we are developing. The building of a Monte Carlo Hamiltonian, projecting to the ground state, sampling two-body operators, phaseless approximation, and measuring ground state properties are discussed in detail. An advanced implementation for multi-determinant trial wave functions is described, which dramatically speeds up the algorithm and reduces the memory cost. We propose a self-consistent constraint for real materials, and discuss two flavors for its realization, either by coupling the AFQMC calculation to an effective independent-electron calculation or via the natural orbitals of the computed one-body density matrix.

arXiv:2009.13585•The Journal of Chemical Physics•Jan 11, 2021•61 citations

Novel Quantum Monte Carlo Approaches for Quantum Liquids

Brenda M. Rubenstein

Quantum Monte Carlo methods are a powerful suite of techniques for solving the quantum many-body problem. By using random numbers to stochastically sample quantum properties, QMC methods are capable of studying low-temperature quantum systems well beyond the reach of conventional deterministic techniques. QMC techniques have likewise been indispensible tools for augmenting our current knowledge of superfluidity and superconductivity. In this thesis, I present two new quantum Monte Carlo techniques, the Monte Carlo Power Method and Bose-Fermi Auxiliary-Field Quantum Monte Carlo, and apply previously developed Path Integral Monte Carlo methods to explore two new phases of quantum hard spheres and hydrogen. I lay the foundation for a subsequent description of my research by first reviewing the physics of quantum liquids in Chapter One and the mathematics behind Quantum Monte Carlo algorithms in Chapter Two. I then discuss the Monte Carlo Power Method, a stochastic way of computing the first several extremal eigenvalues of a matrix too memory-intensive to be stored and therefore diagonalized. As an illustration of the technique, I demonstrate how it can be used to determine the second eigenvalues of the transition matrices of several popular Monte Carlo algorithms. This information may be used to quantify how rapidly a Monte Carlo algorithm is converging to the equilibrium probability distribution it is sampling. I next present the Bose-Fermi Auxiliary-Field Quantum Monte Carlo algorithm. This algorithm generalizes the well-known Auxiliary-Field Quantum Monte Carlo algorithm for fermions to bosons and Bose-Fermi mixtures. Despite some shortcomings, the Bose-Fermi Auxiliary-Field Quantum Monte Carlo algorithm represents the first exact technique capable of studying Bose-Fermi mixtures of any size in any dimension. In Chapter Six, I describe a new Constant Stress Path Integral Monte Carlo algorithm for the study of quantum mechanical systems under high pressures. While the eventual hope is to apply this algorithm to the exploration of yet unidentified high-pressure, low-temperature phases of hydrogen, I employ this algorithm to determine whether or not quantum hard spheres can form a low-temperature bcc solid if exchange is not taken into account. In the final chapter of this thesis, I use Path Integral Monte Carlo once again to explore whether glassy para-hydrogen exhibits superfluidity. Physicists have long searched for ways to coax hydrogen into becoming a superfluid. I present evidence that, while glassy hydrogen does not crystallize at the temperatures at which hydrogen might become a superfluid, it nevertheless does not exhibit superfluidity. This is because the average binding energy per p-H2 molecule poses a severe barrier to exchange regardless of whether the system is crystalline. All in all, this work extends the reach of Quantum Monte Carlo methods to new systems and brings the power of existing methods to bear on new problems.

•Jan 1, 2013•0 citations

Linearized auxiliary fields Monte Carlo technique: Efficient sampling of the fermion sign

Sandro Sorella

We introduce a method that combines the power of both the lattice Green' function Monte Carlo (LGFMC) with the auxiliary field quantum Monte Carlo (AFQMC) techniques, and allows us to compute exact ground-state properties of the Hubbard model for $U\ensuremath{\lesssim}4t$ on finite clusters. Thanks to LGFMC, one obtains unbiased zero temperature results, not affected by the so-called Trotter approximation of the imaginary time propagator ${e}^{\ensuremath{-}H\ensuremath{\tau}}$. At the same time, the AFQMC formalism yields a remarkably fast convergence in $\ensuremath{\tau}$ before the fermion sign problem becomes prohibitive. As an application we report ground-state energies of the Hubbard model at $U/t=4$ with up to 100 sites.

arXiv:1111.6208•Physical Review B•Dec 29, 2011•24 citations
Finite temperature auxiliary field-based quantum Monte Carlo methods, including determinant quantum Monte Carlo and Auxiliary Field Quantum Monte Carlo (AFQMC), have historically assumed pivotal roles in the investigation of the finite temperature phase diagrams of a wide variety of multidimensional lattice models and materials. Despite their utility, however, these techniques are typically formulated in the grand canonical ensemble, which makes them difficult to apply to condensates such as superfluids and difficult to benchmark against alternative methods that are formulated in the canonical ensemble. Working in the grand canonical ensemble is furthermore accompanied by the increased overhead associated with having to determine the chemical potentials that produce desired fillings. Given this backdrop, in this work, we present a new recursive approach for performing AFQMC simulations in the canonical ensemble that does not require knowledge of chemical potentials. To derive this approach, we exploit the convenient fact that AFQMC solves the many-body problem by decoupling many-body propagators into integrals over one-body problems to which non-interacting theories can be applied. We benchmark the accuracy of our technique on illustrative Bose and Fermi-Hubbard models and demonstrate that it can converge more quickly to the ground state than grand canonical AFQMC simulations. We believe that our novel use of HS-transformed operators to implement algorithms originally derived for non-interacting systems will motivate the development of a variety of other methods and anticipate that our technique will enable direct performance comparisons against other many-body approaches formulated in the canonical ensemble.
Many experimentally accessible, finite-sized interacting quantum systems are most appropriately described by the canonical ensemble of statistical mechanics. Conventional numerical simulation methods either approximate them as being coupled to a particle bath or use projective algorithms which may suffer from nonoptimal scaling with system size or large algorithmic prefactors. In this paper, we introduce a highly stable, recursive auxiliary field quantum Monte Carlo approach that can directly simulate systems in the canonical ensemble. We apply the method to the fermion Hubbard model in one and two spatial dimensions in a regime known to exhibit a significant "sign" problem and find improved performance over existing approaches including rapid convergence to ground-state expectation values. The effects of excitations above the ground state are quantified using an estimator-agnostic approach including studying the temperature dependence of the purity and overlap fidelity of the canonical and grand canonical density matrices. As an important application, we show that thermometry approaches often exploited in ultracold atoms that employ an analysis of the velocity distribution in the grand canonical ensemble may be subject to errors leading to an underestimation of extracted temperatures with respect to the Fermi temperature.
We present a quantum Monte Carlo (QMC) technique for calculating the exact finite-temperature properties of Bose-Fermi mixtures. The Bose-Fermi auxiliary-field quantum Monte Carlo (BFAFQMC) algorithm combines two methods, a finite-temperature AFQMC algorithm for bosons and a variant of the standard AFQMC algorithm for fermions, into one algorithm for mixtures. We demonstrate the accuracy of our method by comparing its results for the Bose-Hubbard and Bose-Fermi-Hubbard models against those produced using exact diagonalization for small systems. Comparisons are also made with mean-field theory and the worm algorithm for larger systems. As is the case with most fermion Hamiltonians, a sign or phase problem is present in the BFAFQMC algorithm. We discuss the nature of these problems in this framework and describe how they can be controlled with well-studied approximations to expand the BFAFQMC algorithm's reach. This algorithm can serve as an essential tool for answering many unresolved questions about many-body physics in mixed Bose-Fermi systems.
We present an ab initio auxiliary field quantum Monte Carlo method for studying the electronic structure of molecules, solids, and model Hamiltonians at finite temperature. The algorithm marries the ab initio phaseless auxiliary field quantum Monte Carlo algorithm known to produce high accuracy ground state energies of molecules and solids with its finite temperature variant, long used by condensed matter physicists for studying model Hamiltonian phase diagrams, to yield a phaseless, ab initio finite temperature method. We demonstrate that the method produces internal energies within chemical accuracy of exact diagonalization results across a wide range of temperatures for H 2 O (STO-3G), C 2 (STO-6G), the one-dimensional hydrogen chain (STO-6G), and the multiorbital Hubbard model. Our method effectively controls the phase problem through importance sampling, often even without invoking the phaseless approximation, down to temperatures at which the systems studied approach their ground states and may therefore be viewed as exact over wide temperature ranges. This technique embodies a versatile tool for studying the finite temperature phase diagrams of a plethora of systems whose properties cannot be captured by a Hubbard U term alone. Our results moreover illustrate that the severity of the phase problem for model Hamiltonians far exceeds that for many molecules at all of the temperatures studied.
The auxiliary-field quantum Monte Carlo (AFQMC) method is a general numerical method for correlated many-electron systems, which is being increasingly applied in lattice models, atoms, molecules, and solids. Here, we introduce the theory and algorithm of the method specialized for real materials and present several recent developments. We give a systematic exposition of the key steps of AFQMC, closely tracking the framework of a modern software library we are developing. The building of a Monte Carlo Hamiltonian, projecting to the ground state, sampling two-body operators, phaseless approximation, and measuring ground state properties are discussed in detail. An advanced implementation for multi-determinant trial wave functions is described, which dramatically speeds up the algorithm and reduces the memory cost. We propose a self-consistent constraint for real materials, and discuss two flavors for its realization, either by coupling the AFQMC calculation to an effective independent-electron calculation or via the natural orbitals of the computed one-body density matrix.
Quantum Monte Carlo methods are a powerful suite of techniques for solving the quantum many-body problem. By using random numbers to stochastically sample quantum properties, QMC methods are capable of studying low-temperature quantum systems well beyond the reach of conventional deterministic techniques. QMC techniques have likewise been indispensible tools for augmenting our current knowledge of superfluidity and superconductivity. In this thesis, I present two new quantum Monte Carlo techniques, the Monte Carlo Power Method and Bose-Fermi Auxiliary-Field Quantum Monte Carlo, and apply previously developed Path Integral Monte Carlo methods to explore two new phases of quantum hard spheres and hydrogen. I lay the foundation for a subsequent description of my research by first reviewing the physics of quantum liquids in Chapter One and the mathematics behind Quantum Monte Carlo algorithms in Chapter Two. I then discuss the Monte Carlo Power Method, a stochastic way of computing the first several extremal eigenvalues of a matrix too memory-intensive to be stored and therefore diagonalized. As an illustration of the technique, I demonstrate how it can be used to determine the second eigenvalues of the transition matrices of several popular Monte Carlo algorithms. This information may be used to quantify how rapidly a Monte Carlo algorithm is converging to the equilibrium probability distribution it is sampling. I next present the Bose-Fermi Auxiliary-Field Quantum Monte Carlo algorithm. This algorithm generalizes the well-known Auxiliary-Field Quantum Monte Carlo algorithm for fermions to bosons and Bose-Fermi mixtures. Despite some shortcomings, the Bose-Fermi Auxiliary-Field Quantum Monte Carlo algorithm represents the first exact technique capable of studying Bose-Fermi mixtures of any size in any dimension. In Chapter Six, I describe a new Constant Stress Path Integral Monte Carlo algorithm for the study of quantum mechanical systems under high pressures. While the eventual hope is to apply this algorithm to the exploration of yet unidentified high-pressure, low-temperature phases of hydrogen, I employ this algorithm to determine whether or not quantum hard spheres can form a low-temperature bcc solid if exchange is not taken into account. In the final chapter of this thesis, I use Path Integral Monte Carlo once again to explore whether glassy para-hydrogen exhibits superfluidity. Physicists have long searched for ways to coax hydrogen into becoming a superfluid. I present evidence that, while glassy hydrogen does not crystallize at the temperatures at which hydrogen might become a superfluid, it nevertheless does not exhibit superfluidity. This is because the average binding energy per p-H2 molecule poses a severe barrier to exchange regardless of whether the system is crystalline. All in all, this work extends the reach of Quantum Monte Carlo methods to new systems and brings the power of existing methods to bear on new problems.
We introduce a method that combines the power of both the lattice Green' function Monte Carlo (LGFMC) with the auxiliary field quantum Monte Carlo (AFQMC) techniques, and allows us to compute exact ground-state properties of the Hubbard model for $U\ensuremath{\lesssim}4t$ on finite clusters. Thanks to LGFMC, one obtains unbiased zero temperature results, not affected by the so-called Trotter approximation of the imaginary time propagator ${e}^{\ensuremath{-}H\ensuremath{\tau}}$. At the same time, the AFQMC formalism yields a remarkably fast convergence in $\ensuremath{\tau}$ before the fermion sign problem becomes prohibitive. As an application we report ground-state energies of the Hubbard model at U/t=4U/t=4U/t=4 with up to 100 sites.