Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:cond-mat/0410098

Analytic continuation of QMC data with a sign problem

Alexandru Macridin, Sumith Doluweera, Mark Jarrell, Thomas Maier

Published Oct 4, 2004• 4 citations
arXivHTMLPDF

Abstract

We present a Maximum Entropy method (MEM) for obtaining dynamical spectra from Quantum Monte Carlo data which have a sign problem. By relating the sign fluctuations to the norm of the spectra, our method properly treats the correlations between the measured quantities and the sign. The method greatly improves the quality and the resolution of the spectra, enabling it to produce good spectra even for poorly conditioned data where standard MEM fails.

DOI
10.48550/arxiv.cond-mat/0410098

Related papers

Dual formulation of the maximum entropy method applied to analytic continuation of quantum Monte Carlo data

Thomas Chuna, Nicholas Barnfield, Tobias Dornheim +2 more

Abstract Many fields of physics use quantum Monte Carlo techniques, but struggle to estimate dynamic spectra via the analytic continuation of imaginary-time quantum Monte Carlo data. One of the most ubiquitous approaches to analytic continuation is the maximum entropy method (MEM). We supply a dual Newton optimization algorithm to be used within the MEM and provide analytic bounds for the algorithm’s error. The optimization algorithm is freely availible on github ( repository ). The MEM is typically used with Bryan’s controversial algorithm (Rothkopf 2020 Data 5 55). We present new theoretical issues that are not yet in the literature. Our algorithm has all the theoretical benefits of Bryan’s algorithm without these theoretical issues the implementation of the dual Newton optimizer within the MEM is freely available on github ( repository ). We compare the MEM with Bryan’s optimization to the MEM with our dual Newton optimization on test problems from lattice quantum chromodynamics and plasma physics. These comparisons show that in the presence of noise the dual Newton algorithm produces better estimates and error bars; this indicates the limits of Bryan’s algorithm’s applicability. We use the MEM to investigate authentic quantum Monte Carlo data for the uniform electron gas at warm dense matter conditions and further substantiate the roton-type feature in the dispersion relation.

arXiv:2501.01869•Journal of Physics A Mathematical and Theoretical•Aug 7, 2025•13 citations

Maximum-entropy method for analytic continuation of quantum Monte Carlo data

Richard N. Silver, Devinderjit Singh Sivia, James E. Gubernatis

An outstanding problem in the simulation of condensed-matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary-time quantum Monte Carlo data to obtain real-frequency spectral functions. This is an extremely ill-posed problem similar to the inversion of a Laplace transform. We suggest an image-reconstruction approach, which has been widely applied to data analysis in experimental research. Specifically, we apply the maximum-entropy method (ME) to the analytic continuation of quantum Monte Carlo data. We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We compare (ME) to alternative methods. We also discuss statistical error propagation for the analytic continuation problem via the likelihood function, which is independent of the choice of image-reconstruction method. This includes the sensitivity of the data to structure in the spectral function, the optimization of Monte Carlo simulations, and how to incorporate covariance in the statistical errors of the Monte Carlo method.

Physical review. B, Condensed matter•Feb 1, 1990•306 citations

Fast and efficient stochastic optimization for analytic continuation

Feng Bao, Yanfei Tang, Michael S. Summers +4 more

The analytic continuation of imaginary-time quantum Monte Carlo data to extract real-frequency spectra remains a key problem in connecting theory with experiment. Here we present a fast and efficient stochastic optimization method (FESOM) as a more accessible variant of the stochastic optimization method introduced by Mishchenko et al. [Phys. Rev. B 62, 6317 (2000)], and we benchmark the resulting spectra with those obtained by the standard maximum entropy method for three representative test cases, including data taken from studies of the two-dimensional Hubbard model. We generally find that our FESOM approach yields spectra similar to the maximum entropy results. In particular, while the maximum entropy method yields superior results when the quality of the data is strong, we find that FESOM is able to resolve fine structure with more detail when the quality of the data is poor. In addition, because of its stochastic nature, the method provides detailed information on the frequency-dependent uncertainty of the resulting spectra, while the maximum entropy method does so only for the spectral weight integrated over a finite frequency region. We therefore believe that this variant of the stochastic optimization approach provides a viable alternative to the routinely used maximum entropy method, especially for data of poor quality.

arXiv:1609.02578•Physical review. B./Physical review. B•Sep 28, 2016•16 citations

Noiseless limit and improved-prior limit of the maximum entropy method and their implications for the analytic continuation problem

Thomas Chuna, Nicholas Barnfield, Paul Hamann +3 more

Quantum Monte Carlo (QMC) methods are uniquely capable of providing exact simulations of quantum many-body systems. Unfortunately, the applications of a QMC simulation are limited because extracting dynamic properties requires solving the analytic continuation problem. Across the many fields that use QMC methods, there is no universally accepted analytic continuation algorithm for extracting dynamic properties, but many publications compare to the maximum entropy method. We investigate when entropy maximization is an acceptable approach. We show that stochastic sampling algorithms reduce to entropy maximization when the Bayesian prior is near to the true solution. We investigate when is Bryan’s controversial optimization algorithm [Bryan, for entropy maximization (sometimes known as the maximum entropy method—MEM) appropriate to use. We show that Bryan’s algorithm is appropriate when the noise is near zero or when the Bayesian prior is near the true solution. We also investigate the mean squared error, finding a better scaling when the Bayesian prior is near the true solution than when the noise is near zero. Together, these three results indicate that enhancing the quality of the Bayesian prior enhances the validity of the MEM and has better return on investment than reducing the noise. We point to examples of improved data-driven Bayesian priors that have already leveraged this advantage. We support these results by solving the double Gaussian problem using both Bryan’s algorithm and the newly formulated dual approach to entropy maximization [Chuna , .

arXiv:2511.06915•Physical Review Research•May 11, 2026•1 citation

Dynamical properties from quantum Monte Carlo by the Maximum Entropy Method

Richard N. Silver, Devinderjit Singh Sivia, James E. Gubernatis

An outstanding problem in the simulation of condensed matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary time Quantum Monte Carlo data to obtain real frequency spectral functions. We suggest an image reconstruction approach which has been widely applied to data analysis in experimental research, the Maximum Entropy Method (MaxEnt). We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We also compare MaxEnt to alternative methods. 17 refs., 4 figs.

•Jan 1, 1989•1 citation

Progress on stochastic analytic continuation of quantum Monte Carlo data

Hui Shao, Anders W. Sandvik

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.

arXiv:2202.09870•Physics Reports•Dec 21, 2022•90 citations
We present a Maximum Entropy method (MEM) for obtaining dynamical spectra from Quantum Monte Carlo data which have a sign problem. By relating the sign fluctuations to the norm of the spectra, our method properly treats the correlations between the measured quantities and the sign. The method greatly improves the quality and the resolution of the spectra, enabling it to produce good spectra even for poorly conditioned data where standard MEM fails.
Abstract Many fields of physics use quantum Monte Carlo techniques, but struggle to estimate dynamic spectra via the analytic continuation of imaginary-time quantum Monte Carlo data. One of the most ubiquitous approaches to analytic continuation is the maximum entropy method (MEM). We supply a dual Newton optimization algorithm to be used within the MEM and provide analytic bounds for the algorithm’s error. The optimization algorithm is freely availible on github ( repository ). The MEM is typically used with Bryan’s controversial algorithm (Rothkopf 2020 Data 5 55). We present new theoretical issues that are not yet in the literature. Our algorithm has all the theoretical benefits of Bryan’s algorithm without these theoretical issues the implementation of the dual Newton optimizer within the MEM is freely available on github ( repository ). We compare the MEM with Bryan’s optimization to the MEM with our dual Newton optimization on test problems from lattice quantum chromodynamics and plasma physics. These comparisons show that in the presence of noise the dual Newton algorithm produces better estimates and error bars; this indicates the limits of Bryan’s algorithm’s applicability. We use the MEM to investigate authentic quantum Monte Carlo data for the uniform electron gas at warm dense matter conditions and further substantiate the roton-type feature in the dispersion relation.
An outstanding problem in the simulation of condensed-matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary-time quantum Monte Carlo data to obtain real-frequency spectral functions. This is an extremely ill-posed problem similar to the inversion of a Laplace transform. We suggest an image-reconstruction approach, which has been widely applied to data analysis in experimental research. Specifically, we apply the maximum-entropy method (ME) to the analytic continuation of quantum Monte Carlo data. We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We compare (ME) to alternative methods. We also discuss statistical error propagation for the analytic continuation problem via the likelihood function, which is independent of the choice of image-reconstruction method. This includes the sensitivity of the data to structure in the spectral function, the optimization of Monte Carlo simulations, and how to incorporate covariance in the statistical errors of the Monte Carlo method.
The analytic continuation of imaginary-time quantum Monte Carlo data to extract real-frequency spectra remains a key problem in connecting theory with experiment. Here we present a fast and efficient stochastic optimization method (FESOM) as a more accessible variant of the stochastic optimization method introduced by Mishchenko et al. [Phys. Rev. B 62, 6317 (2000)], and we benchmark the resulting spectra with those obtained by the standard maximum entropy method for three representative test cases, including data taken from studies of the two-dimensional Hubbard model. We generally find that our FESOM approach yields spectra similar to the maximum entropy results. In particular, while the maximum entropy method yields superior results when the quality of the data is strong, we find that FESOM is able to resolve fine structure with more detail when the quality of the data is poor. In addition, because of its stochastic nature, the method provides detailed information on the frequency-dependent uncertainty of the resulting spectra, while the maximum entropy method does so only for the spectral weight integrated over a finite frequency region. We therefore believe that this variant of the stochastic optimization approach provides a viable alternative to the routinely used maximum entropy method, especially for data of poor quality.
Quantum Monte Carlo (QMC) methods are uniquely capable of providing exact simulations of quantum many-body systems. Unfortunately, the applications of a QMC simulation are limited because extracting dynamic properties requires solving the analytic continuation problem. Across the many fields that use QMC methods, there is no universally accepted analytic continuation algorithm for extracting dynamic properties, but many publications compare to the maximum entropy method. We investigate when entropy maximization is an acceptable approach. We show that stochastic sampling algorithms reduce to entropy maximization when the Bayesian prior is near to the true solution. We investigate when is Bryan’s controversial optimization algorithm [Bryan, for entropy maximization (sometimes known as the maximum entropy method—MEM) appropriate to use. We show that Bryan’s algorithm is appropriate when the noise is near zero or when the Bayesian prior is near the true solution. We also investigate the mean squared error, finding a better scaling when the Bayesian prior is near the true solution than when the noise is near zero. Together, these three results indicate that enhancing the quality of the Bayesian prior enhances the validity of the MEM and has better return on investment than reducing the noise. We point to examples of improved data-driven Bayesian priors that have already leveraged this advantage. We support these results by solving the double Gaussian problem using both Bryan’s algorithm and the newly formulated dual approach to entropy maximization [Chuna , .
An outstanding problem in the simulation of condensed matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary time Quantum Monte Carlo data to obtain real frequency spectral functions. We suggest an image reconstruction approach which has been widely applied to data analysis in experimental research, the Maximum Entropy Method (MaxEnt). We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We also compare MaxEnt to alternative methods. 17 refs., 4 figs.
We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.