Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2004.01155 · Physical review. B./Physical review. B

Extending the average spectrum method: Grid point sampling and density averaging

Khaldoon Ghanem, Erik Koch

Published Jul 6, 2020• 20 citations
arXivHTMLPDF

Abstract

Analytic continuation of imaginary time or frequency data to the real axis is a crucial step in extracting dynamical properties from quantum Monte Carlo simulations. The average spectrum method provides an elegant solution by integrating over all nonnegative spectra weighted by how well they fit the data. In a recent paper, we found that discretizing the functional integral, as in Feynman's path-integrals, does not have a well-defined continuum limit. Instead, the limit depends on the discretization grid whose choice may strongly bias the results. In this paper, we demonstrate that sampling the grid points, instead of keeping them fixed, also changes the functional integral limit and rather helps to overcome the bias considerably. We provide an efficient algorithm for doing the sampling and show how the density of the grid points acts now as a default model with a significantly reduced biasing effect. The remaining bias depends mainly on the width of the grid density, so we go one step further and average also over densities of different widths. For a certain class of densities, including Gaussian and exponential ones, this width averaging can be done analytically, eliminating the need to specify this parameter without introducing any computational overhead.

DOI
10.1103/physrevb.102.035114

Related papers

Average spectrum method for analytic continuation: Efficient blocked-mode sampling and dependence on the discretization grid

Khaldoon Ghanem, Erik Koch

The average spectrum method is a promising approach for the analytic continuation of imaginary time or frequency data to the real axis. It determines the analytic continuation of noisy data from a functional average over all admissible spectral functions, weighted by how well they fit the data. Its main advantage is the apparent lack of adjustable parameters and smoothness constraints, using instead the information on the statistical noise in the data. Its main disadvantage is the enormous computational cost of performing the functional integral. Here we introduce an efficient implementation, based on the singular value decomposition of the integral kernel, eliminating this problem. It allows us to analyze the behavior of the average spectrum method in detail. We find that the discretization of the real-frequency grid, on which the spectral function is represented, biases the results. The distribution of the grid points plays the role of a default model while the number of grid points acts as a regularization parameter. We give a quantitative explanation for this behavior, point out the crucial role of the default model and provide a practical method for choosing it, making the average spectrum method a reliable and efficient technique for analytic continuation.

arXiv:1912.01379•Physical review. B./Physical review. B•Feb 10, 2020•26 citations

Stochastische Analytische Fortsetzung: Ein Bayesscher Ansatz

Khaldoon Ghanem

The stochastic sampling method (StochS) is used for the analytic continuation of quantum Monte Carlo data from the imaginary axis to the real axis. Compared to the maximum entropy method, StochS does not have explicit parameters, and one would expect the results to be unbiased. We present a very efficient algorithm for performing StochS and use it to study the effect of the discretization grid. Surprisingly, we find that the grid affects the results of StochS acting as an implicit default model. We provide a recipe for choosing a reliable StochS grid.To reduce the effect of the grid, we extend StochS into a gridless method (gStochS) by sampling the grid points from a default model instead of having them fixed. The effect of the default model is much reduced in gStochS compared to StochS and depends mainly on its width rather than its shape. The proper width can then be chosen using a simple recipe like we did in StochS.Finally, to avoid fixing the width, we go one step further and extend gStochS to sample over a whole class of default models with different widths. The extended method (eStochS) is then able to automatically relocate the grid points and concentrate them in the important region. Test cases show that eStochS gives good results resolving sharp features in the spectrum without the need for fine tuning a default model.

•Jan 1, 2017•5 citations

Progress on stochastic analytic continuation of quantum Monte Carlo data

Hui Shao, Anders W. Sandvik

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.

arXiv:2202.09870•Physics Reports•Dec 21, 2022•90 citations

Numerical Feynman integrals with physically inspired interpolation: Faster convergence and significant reduction of computational cost

Nikesh S. Dattani

One of the most successful methods for calculating reduced density operator dynamics in open quantum systems, that can give numerically exact results, uses Feynman integrals. However, when simulating the dynamics for a given amount of time, the number of time steps that can realistically be used with this method is always limited, therefore one often obtains an approximation of the reduced density operator at a sparse grid of points in time. Instead of relying only on ad hoc interpolation methods (such as splines) to estimate the system density operator in between these points, I propose a method that uses physical information to assist with this interpolation. This method is tested on a physically significant system, on which its use allows important qualitative features of the density operator dynamics to be captured with as little as two time steps in the Feynman integral. This method allows for an enormous reduction in the amount of memory and CPU time required for approximating density operator dynamics within a desired accuracy. Since this method does not change the way the Feynman integral itself is calculated, the value of the density operator approximation at the points in time used to discretize the Feynamn integral will be the same whether or not this method is used, but its approximation in between these points in time is considerably improved by this method. A list of ways in which this proposed method can be further improved is presented in the last section of the article.

AIP Advances•Jan 19, 2012•16 citations

Grid-based diffusion Monte Carlo for fermions without the fixed-node approximation

Alexander A. Kunitsa, So Hirata

A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. The method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015E_{h} of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10^{-5}E_{h} without an importance sampling or Jastrow factor.

arXiv:1811.03000•Physical review. E•Jan 27, 2020•12 citations

Parameter-free analytic continuation for quantum many-body calculations

Mancheon Han, Hyoung Joon Choi

We develop a reliable parameter-free analytic continuation method for quantum many-body calculations. Our method is based on a kernel grid, a causal spline, a regularization using the second-derivative roughness penalty, and the L-curve criterion. We also develop the L-curve averaged deviation to estimate the precision of our analytic continuation. To deal with statistically obtained data more efficiently, we further develop a bootstrap-averaged analytic continuation method. In the test using the exact imaginary-frequency Green's function with added statistical error, our method produces the spectral function that converges systematically to the exact one as the statistical error decreases. As an application, we simulate the two-orbital Hubbard model for various electron numbers with the dynamical-mean field theory in the imaginary time and obtain the real-frequency self-energy with our analytic continuation method, clearly identifying a non-Fermi-liquid behavior as the electron number approaches the half filling from the quarter filling. Our analytic continuation can be used widely, and it will facilitate drawing clear conclusions from imaginary-time quantum many-body calculations.

arXiv:2301.00129•Physical review. B./Physical review. B•Dec 29, 2022•2 citations
Analytic continuation of imaginary time or frequency data to the real axis is a crucial step in extracting dynamical properties from quantum Monte Carlo simulations. The average spectrum method provides an elegant solution by integrating over all nonnegative spectra weighted by how well they fit the data. In a recent paper, we found that discretizing the functional integral, as in Feynman's path-integrals, does not have a well-defined continuum limit. Instead, the limit depends on the discretization grid whose choice may strongly bias the results. In this paper, we demonstrate that sampling the grid points, instead of keeping them fixed, also changes the functional integral limit and rather helps to overcome the bias considerably. We provide an efficient algorithm for doing the sampling and show how the density of the grid points acts now as a default model with a significantly reduced biasing effect. The remaining bias depends mainly on the width of the grid density, so we go one step further and average also over densities of different widths. For a certain class of densities, including Gaussian and exponential ones, this width averaging can be done analytically, eliminating the need to specify this parameter without introducing any computational overhead.
The average spectrum method is a promising approach for the analytic continuation of imaginary time or frequency data to the real axis. It determines the analytic continuation of noisy data from a functional average over all admissible spectral functions, weighted by how well they fit the data. Its main advantage is the apparent lack of adjustable parameters and smoothness constraints, using instead the information on the statistical noise in the data. Its main disadvantage is the enormous computational cost of performing the functional integral. Here we introduce an efficient implementation, based on the singular value decomposition of the integral kernel, eliminating this problem. It allows us to analyze the behavior of the average spectrum method in detail. We find that the discretization of the real-frequency grid, on which the spectral function is represented, biases the results. The distribution of the grid points plays the role of a default model while the number of grid points acts as a regularization parameter. We give a quantitative explanation for this behavior, point out the crucial role of the default model and provide a practical method for choosing it, making the average spectrum method a reliable and efficient technique for analytic continuation.
The stochastic sampling method (StochS) is used for the analytic continuation of quantum Monte Carlo data from the imaginary axis to the real axis. Compared to the maximum entropy method, StochS does not have explicit parameters, and one would expect the results to be unbiased. We present a very efficient algorithm for performing StochS and use it to study the effect of the discretization grid. Surprisingly, we find that the grid affects the results of StochS acting as an implicit default model. We provide a recipe for choosing a reliable StochS grid.To reduce the effect of the grid, we extend StochS into a gridless method (gStochS) by sampling the grid points from a default model instead of having them fixed. The effect of the default model is much reduced in gStochS compared to StochS and depends mainly on its width rather than its shape. The proper width can then be chosen using a simple recipe like we did in StochS.Finally, to avoid fixing the width, we go one step further and extend gStochS to sample over a whole class of default models with different widths. The extended method (eStochS) is then able to automatically relocate the grid points and concentrate them in the important region. Test cases show that eStochS gives good results resolving sharp features in the spectrum without the need for fine tuning a default model.
We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.
One of the most successful methods for calculating reduced density operator dynamics in open quantum systems, that can give numerically exact results, uses Feynman integrals. However, when simulating the dynamics for a given amount of time, the number of time steps that can realistically be used with this method is always limited, therefore one often obtains an approximation of the reduced density operator at a sparse grid of points in time. Instead of relying only on ad hoc interpolation methods (such as splines) to estimate the system density operator in between these points, I propose a method that uses physical information to assist with this interpolation. This method is tested on a physically significant system, on which its use allows important qualitative features of the density operator dynamics to be captured with as little as two time steps in the Feynman integral. This method allows for an enormous reduction in the amount of memory and CPU time required for approximating density operator dynamics within a desired accuracy. Since this method does not change the way the Feynman integral itself is calculated, the value of the density operator approximation at the points in time used to discretize the Feynamn integral will be the same whether or not this method is used, but its approximation in between these points in time is considerably improved by this method. A list of ways in which this proposed method can be further improved is presented in the last section of the article.
A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. The method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015E_{h} of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10^{-5}E_{h} without an importance sampling or Jastrow factor.
We develop a reliable parameter-free analytic continuation method for quantum many-body calculations. Our method is based on a kernel grid, a causal spline, a regularization using the second-derivative roughness penalty, and the L-curve criterion. We also develop the L-curve averaged deviation to estimate the precision of our analytic continuation. To deal with statistically obtained data more efficiently, we further develop a bootstrap-averaged analytic continuation method. In the test using the exact imaginary-frequency Green's function with added statistical error, our method produces the spectral function that converges systematically to the exact one as the statistical error decreases. As an application, we simulate the two-orbital Hubbard model for various electron numbers with the dynamical-mean field theory in the imaginary time and obtain the real-frequency self-energy with our analytic continuation method, clearly identifying a non-Fermi-liquid behavior as the electron number approaches the half filling from the quarter filling. Our analytic continuation can be used widely, and it will facilitate drawing clear conclusions from imaginary-time quantum many-body calculations.