Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:cond-mat/0403055

Identifying the maximum entropy method as a special limit of stochastic analytic continuation

K. S. D. Beach

Published Mar 1, 2004• 291 citations
arXivHTMLPDF

Abstract

The maximum entropy method is shown to be a special limit of the stochastic analytic continuation method introduced by Sandvik [Phys. Rev. B 57, 10287 (1998)]. We employ a mapping between the analytic continuation problem and a system of interacting classical fields. The Hamiltonian of this system is chosen such that the determination of its ground state field configuration corresponds to an unregularized inversion of the analytic continuation input data. The regularization is effected by performing a thermal average over the field configurations at a small fictitious temperature using Monte Carlo sampling. We prove that the maximum entropy method, the currently accepted state of the art, is simply the mean field limit of this fully dynamical procedure. We also describe a technical innovation: we suggest that a parallel tempering algorithm leads to better traversal of the phase space and makes it easy to identify the critical value of the regularization temperature.

DOI
10.48550/arxiv.cond-mat/0403055

Related papers

Progress on stochastic analytic continuation of quantum Monte Carlo data

Hui Shao, Anders W. Sandvik

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.

arXiv:2202.09870•Physics Reports•Dec 21, 2022•104 citations

Noiseless limit and improved-prior limit of the maximum entropy method and their implications for the analytic continuation problem

Thomas Chuna, Nicholas Barnfield, Paul Hamann +3 more

Quantum Monte Carlo (QMC) methods are uniquely capable of providing exact simulations of quantum many-body systems. Unfortunately, the applications of a QMC simulation are limited because extracting dynamic properties requires solving the analytic continuation problem. Across the many fields that use QMC methods, there is no universally accepted analytic continuation algorithm for extracting dynamic properties, but many publications compare to the maximum entropy method. We investigate when entropy maximization is an acceptable approach. We show that stochastic sampling algorithms reduce to entropy maximization when the Bayesian prior is near to the true solution. We investigate when is Bryan’s controversial optimization algorithm [Bryan, for entropy maximization (sometimes known as the maximum entropy method—MEM) appropriate to use. We show that Bryan’s algorithm is appropriate when the noise is near zero or when the Bayesian prior is near the true solution. We also investigate the mean squared error, finding a better scaling when the Bayesian prior is near the true solution than when the noise is near zero. Together, these three results indicate that enhancing the quality of the Bayesian prior enhances the validity of the MEM and has better return on investment than reducing the noise. We point to examples of improved data-driven Bayesian priors that have already leveraged this advantage. We support these results by solving the double Gaussian problem using both Bryan’s algorithm and the newly formulated dual approach to entropy maximization [Chuna , .

arXiv:2511.06915•Physical Review Research•May 11, 2026•8 citations

Stochastic method for analytic continuation of quantum Monte Carlo data

Anders W. Sandvik

A method for analytic continuation of quantum Monte Carlo data is presented. The spectrum $A(\ensuremath{\omega})$ is parametrized as a sum of $\ensuremath{\delta}$ functions, the weights ${A}_{i}$ of which are sampled according to a distribution $p(A)\ensuremath{\sim}\mathrm{exp}(\ensuremath{-}{\ensuremath{\chi}}^{2}/\ensuremath{\Theta})$. It is argued that the calculated entropy $S$ provides a criterion for determining the $\ensuremath{\Theta}$ corresponding to the ``best'' averaged spectrum. The appearance of spurious structure is signaled by a sharp drop in $〈S(\ensuremath{\Theta})〉$, which in test cases is preceded by a local maximum. Results for the dynamic spin structure factor of a $16$-site Heisenberg chain obtained at this maximum are in better agreement with exact results than ``classic'' maximum-entropy results.

Physical review. B, Condensed matter•May 1, 1998•317 citations

Dual formulation of the maximum entropy method applied to analytic continuation of quantum Monte Carlo data

Thomas Chuna, Nicholas Barnfield, Tobias Dornheim +2 more

Abstract Many fields of physics use quantum Monte Carlo techniques, but struggle to estimate dynamic spectra via the analytic continuation of imaginary-time quantum Monte Carlo data. One of the most ubiquitous approaches to analytic continuation is the maximum entropy method (MEM). We supply a dual Newton optimization algorithm to be used within the MEM and provide analytic bounds for the algorithm’s error. The optimization algorithm is freely availible on github ( repository ). The MEM is typically used with Bryan’s controversial algorithm (Rothkopf 2020 Data 5 55). We present new theoretical issues that are not yet in the literature. Our algorithm has all the theoretical benefits of Bryan’s algorithm without these theoretical issues the implementation of the dual Newton optimizer within the MEM is freely available on github ( repository ). We compare the MEM with Bryan’s optimization to the MEM with our dual Newton optimization on test problems from lattice quantum chromodynamics and plasma physics. These comparisons show that in the presence of noise the dual Newton algorithm produces better estimates and error bars; this indicates the limits of Bryan’s algorithm’s applicability. We use the MEM to investigate authentic quantum Monte Carlo data for the uniform electron gas at warm dense matter conditions and further substantiate the roton-type feature in the dispersion relation.

arXiv:2501.01869•Journal of Physics A Mathematical and Theoretical•Aug 7, 2025•23 citations

Analytic Continuation of Quantum Monte Carlo Data: Optimal Stochastic Regularization Approach

Igor S. Krivenko, Alexey N. Rubtsov

A new algorithm for analytic continuation of noisy quantum Monte Carlo (QMC) data from the Matsubara domain to real frequencies is proposed. Unlike the widely used maximum-entropy (MaxEnt) procedure, our method is linear with respect to input data and can therefore be applied to off-diagonal components of a thermal Green's function, or to a self-energy function. The latter possibility is used to analyze QMC results for the half-filled single-band Hubbard model on a Bethe lattice at a low temperature. Our method qualitatively resolves peaks near the inner edges of the Hubbard bands in the vicinity of a Mott transition, whereas a MaxEnt procedure does not. An existence of such structures has been clearly established before in a high-precision D-DMRG calculation by Karski et al. We also analyze a stability of the new method subject to changes of adjustable parameters.

arXiv:cond-mat/0612233•Dec 9, 2006•13 citations

Constrained sampling method for analytic continuation

Anders W. Sandvik

A method for analytic continuation of imaginary-time correlation functions (here obtained in quantum Monte Carlo simulations) to real-frequency spectral functions is proposed. Stochastically sampling a spectrum parametrized by a large number of δ functions, treated as a statistical-mechanics problem, it avoids distortions caused by (as demonstrated here) configurational entropy in previous sampling methods. The key development is the suppression of entropy by constraining the spectral weight to within identifiable optimal bounds and imposing a set number of peaks. As a test case, the dynamic structure factor of the S=1/2 Heisenberg chain is computed. Very good agreement is found with Bethe ansatz results in the ground state (including a sharp edge) and with exact diagonalization of small systems at elevated temperatures.

arXiv:1502.06066•Physical review. E•Dec 27, 2016•116 citations
The maximum entropy method is shown to be a special limit of the stochastic analytic continuation method introduced by Sandvik [Phys. Rev. B 57, 10287 (1998)]. We employ a mapping between the analytic continuation problem and a system of interacting classical fields. The Hamiltonian of this system is chosen such that the determination of its ground state field configuration corresponds to an unregularized inversion of the analytic continuation input data. The regularization is effected by performing a thermal average over the field configurations at a small fictitious temperature using Monte Carlo sampling. We prove that the maximum entropy method, the currently accepted state of the art, is simply the mean field limit of this fully dynamical procedure. We also describe a technical innovation: we suggest that a parallel tempering algorithm leads to better traversal of the phase space and makes it easy to identify the critical value of the regularization temperature.
We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.
Quantum Monte Carlo (QMC) methods are uniquely capable of providing exact simulations of quantum many-body systems. Unfortunately, the applications of a QMC simulation are limited because extracting dynamic properties requires solving the analytic continuation problem. Across the many fields that use QMC methods, there is no universally accepted analytic continuation algorithm for extracting dynamic properties, but many publications compare to the maximum entropy method. We investigate when entropy maximization is an acceptable approach. We show that stochastic sampling algorithms reduce to entropy maximization when the Bayesian prior is near to the true solution. We investigate when is Bryan’s controversial optimization algorithm [Bryan, for entropy maximization (sometimes known as the maximum entropy method—MEM) appropriate to use. We show that Bryan’s algorithm is appropriate when the noise is near zero or when the Bayesian prior is near the true solution. We also investigate the mean squared error, finding a better scaling when the Bayesian prior is near the true solution than when the noise is near zero. Together, these three results indicate that enhancing the quality of the Bayesian prior enhances the validity of the MEM and has better return on investment than reducing the noise. We point to examples of improved data-driven Bayesian priors that have already leveraged this advantage. We support these results by solving the double Gaussian problem using both Bryan’s algorithm and the newly formulated dual approach to entropy maximization [Chuna , .
A method for analytic continuation of quantum Monte Carlo data is presented. The spectrum $A(\ensuremath{\omega})$ is parametrized as a sum of $\ensuremath{\delta}$ functions, the weights Ai{A}_{i}Ai​ of which are sampled according to a distribution $p(A)\ensuremath{\sim}\mathrm{exp}(\ensuremath{-}{\ensuremath{\chi}}^{2}/\ensuremath{\Theta})$. It is argued that the calculated entropy SSS provides a criterion for determining the $\ensuremath{\Theta}$ corresponding to the ``best'' averaged spectrum. The appearance of spurious structure is signaled by a sharp drop in $〈S(\ensuremath{\Theta})〉$, which in test cases is preceded by a local maximum. Results for the dynamic spin structure factor of a 161616-site Heisenberg chain obtained at this maximum are in better agreement with exact results than ``classic'' maximum-entropy results.
Abstract Many fields of physics use quantum Monte Carlo techniques, but struggle to estimate dynamic spectra via the analytic continuation of imaginary-time quantum Monte Carlo data. One of the most ubiquitous approaches to analytic continuation is the maximum entropy method (MEM). We supply a dual Newton optimization algorithm to be used within the MEM and provide analytic bounds for the algorithm’s error. The optimization algorithm is freely availible on github ( repository ). The MEM is typically used with Bryan’s controversial algorithm (Rothkopf 2020 Data 5 55). We present new theoretical issues that are not yet in the literature. Our algorithm has all the theoretical benefits of Bryan’s algorithm without these theoretical issues the implementation of the dual Newton optimizer within the MEM is freely available on github ( repository ). We compare the MEM with Bryan’s optimization to the MEM with our dual Newton optimization on test problems from lattice quantum chromodynamics and plasma physics. These comparisons show that in the presence of noise the dual Newton algorithm produces better estimates and error bars; this indicates the limits of Bryan’s algorithm’s applicability. We use the MEM to investigate authentic quantum Monte Carlo data for the uniform electron gas at warm dense matter conditions and further substantiate the roton-type feature in the dispersion relation.
A new algorithm for analytic continuation of noisy quantum Monte Carlo (QMC) data from the Matsubara domain to real frequencies is proposed. Unlike the widely used maximum-entropy (MaxEnt) procedure, our method is linear with respect to input data and can therefore be applied to off-diagonal components of a thermal Green's function, or to a self-energy function. The latter possibility is used to analyze QMC results for the half-filled single-band Hubbard model on a Bethe lattice at a low temperature. Our method qualitatively resolves peaks near the inner edges of the Hubbard bands in the vicinity of a Mott transition, whereas a MaxEnt procedure does not. An existence of such structures has been clearly established before in a high-precision D-DMRG calculation by Karski et al. We also analyze a stability of the new method subject to changes of adjustable parameters.
A method for analytic continuation of imaginary-time correlation functions (here obtained in quantum Monte Carlo simulations) to real-frequency spectral functions is proposed. Stochastically sampling a spectrum parametrized by a large number of δ functions, treated as a statistical-mechanics problem, it avoids distortions caused by (as demonstrated here) configurational entropy in previous sampling methods. The key development is the suppression of entropy by constraining the spectral weight to within identifiable optimal bounds and imposing a set number of peaks. As a test case, the dynamic structure factor of the S=1/2 Heisenberg chain is computed. Very good agreement is found with Bethe ansatz results in the ground state (including a sharp edge) and with exact diagonalization of small systems at elevated temperatures.