Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2406.06763 · Physical review. E

Cross validation in stochastic analytic continuation

Gabe Schumm, Sibin Yang, Anders W. Sandvik

Published Nov 25, 2024• 4 citations
arXivHTMLPDF

Abstract

Stochastic analytic continuation (SAC) of quantum Monte Carlo (QMC) imaginary-time correlation function data is a valuable tool in connecting many-body models to experimentally measurable dynamic response functions. Recent developments of the SAC method have allowed for spectral functions with sharp features, e.g., narrow peaks and divergent edges, to be resolved with unprecedented fidelity. Often it is not known what exact sharp features, if any, are present a priori, and, due to the ill-posed nature of the analytic continuation problem, multiple spectral representations may be acceptable. In this work we borrow from the machine learning and statistics literature and implement a cross validation technique to provide an unbiased method to identify the most likely spectrum among a set obtained with different spectral parametrizations and imposed constraints. We demonstrate the power of this method with examples using imaginary-time data generated by QMC simulations and synthetic data generated from artificial spectra. Our procedure, which can be considered a form of model selection, can be applied to a variety of numerical analytic continuation methods, beyond just SAC.

DOI
10.1103/physreve.110.055307

Related papers

Progress on stochastic analytic continuation of quantum Monte Carlo data

Hui Shao, Anders W. Sandvik

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.

arXiv:2202.09870•Physics Reports•Dec 21, 2022•90 citations

Constrained sampling method for analytic continuation

Anders W. Sandvik

A method for analytic continuation of imaginary-time correlation functions (here obtained in quantum Monte Carlo simulations) to real-frequency spectral functions is proposed. Stochastically sampling a spectrum parametrized by a large number of δ functions, treated as a statistical-mechanics problem, it avoids distortions caused by (as demonstrated here) configurational entropy in previous sampling methods. The key development is the suppression of entropy by constraining the spectral weight to within identifiable optimal bounds and imposing a set number of peaks. As a test case, the dynamic structure factor of the S=1/2 Heisenberg chain is computed. Very good agreement is found with Bethe ansatz results in the ground state (including a sharp edge) and with exact diagonalization of small systems at elevated temperatures.

arXiv:1502.06066•Physical review. E•Dec 27, 2016•114 citations

Sparse modeling approach to analytical continuation of imaginary-time quantum Monte Carlo data

Junya Otsuki, Masayuki Ohzeki, Hiroshi Shinaoka +1 more

A data-science approach to solving the ill-conditioned inverse problem for analytical continuation is proposed. The root of the problem lies in the fact that even tiny noise of imaginary-time input data has a serious impact on the inferred real-frequency spectra. By means of a modern regularization technique, we eliminate redundant degrees of freedom that essentially carry the noise, leaving only relevant information unaffected by the noise. The resultant spectrum is represented with minimal bases and thus a stable analytical continuation is achieved. This framework further provides a tool for analyzing to what extent the Monte Carlo data need to be accurate to resolve details of an expected spectral function.

arXiv:1702.03056•Physical review. E•Jun 21, 2017•107 citations

Discovering a well-conditioned analytic continuation problem via dictionary learning

Thomas Chuna, Phil-Alexander Hofmann, Alexander Benedix Robles +1 more

Many fields of physics use quantum Monte Carlo (QMC) simulations to simulate quantum systems in imaginary-time $τ$ and estimate imaginary-time correlation functions (ITCF). However, extracting dynamic $ω$-dependent quantities from ITCFs is a notoriously difficult task, known as analytic continuation (AC), that amounts to solving an exponentially ill-conditioned inverse problem. Within the AC literature, there are competing stochastic and regularized approaches, as well as an emerging collection of works using parameterized models like neural networks. Here we transcend the traditional divides between the communities, introducing the regularized stochastic optimization method (RSOM). This method reformulates AC as a dictionary learning problem, discovering a sparse dictionary to represent the solution. Our approach is motivated by the astounding results dictionary learning has produced in many scientific fields. Remarkably, RSOM discovers a sparse dictionary that maps an ill-conditioned inverse problem to a low-dimensional problem that is well-conditioned. We demonstrate that the method yields competitive results for common synthetic test problems as well as for authentic QMC data from the finite temperature electron gas. This work exposes that a dictionary exists within all stochastic and regularized methods and that dictionary learning provides a new angle of attack for future AC methods.

arXiv:2606.19205•Jun 17, 2026•0 citations

Maximum-entropy method for analytic continuation of quantum Monte Carlo data

Richard N. Silver, Devinderjit Singh Sivia, James E. Gubernatis

An outstanding problem in the simulation of condensed-matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary-time quantum Monte Carlo data to obtain real-frequency spectral functions. This is an extremely ill-posed problem similar to the inversion of a Laplace transform. We suggest an image-reconstruction approach, which has been widely applied to data analysis in experimental research. Specifically, we apply the maximum-entropy method (ME) to the analytic continuation of quantum Monte Carlo data. We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We compare (ME) to alternative methods. We also discuss statistical error propagation for the analytic continuation problem via the likelihood function, which is independent of the choice of image-reconstruction method. This includes the sensitivity of the data to structure in the spectral function, the optimization of Monte Carlo simulations, and how to incorporate covariance in the statistical errors of the Monte Carlo method.

Physical review. B, Condensed matter•Feb 1, 1990•306 citations

Flat histogram quantum Monte Carlo for analytic continuation to real time

Diamantis, Nikolaos G., Efstratios Manousakis

The Quantum Monte Carlo (QMC) method can yield the imaginary-time dependence of a correlation function $C(τ)$ of an operator $\hat O$. The analytic continuation to real-time proceeds by means of a "numerical inversion" of these data to find the response function or spectral density $A(ω)$ corresponding to $\hat O$. Such a technique is very sensitive to the statistical errors in $C(τ)$ especially for large values of $τ$, when we are interested in the low-energy excitations. In this paper, we find that if we use the flat histogram technique in the QMC method, in such a way to make the {\it histogram of} $C(τ)$ flat, the results of the analytic continuation for low-energy excitations improve using the same amount of computational time. To demonstrate the idea we select an exactly soluble version of the single-hole motion in the $t-J$ model and the diagrammatic Monte Carlo technique.

arXiv:1411.5984•Nov 21, 2014•0 citations
Stochastic analytic continuation (SAC) of quantum Monte Carlo (QMC) imaginary-time correlation function data is a valuable tool in connecting many-body models to experimentally measurable dynamic response functions. Recent developments of the SAC method have allowed for spectral functions with sharp features, e.g., narrow peaks and divergent edges, to be resolved with unprecedented fidelity. Often it is not known what exact sharp features, if any, are present a priori, and, due to the ill-posed nature of the analytic continuation problem, multiple spectral representations may be acceptable. In this work we borrow from the machine learning and statistics literature and implement a cross validation technique to provide an unbiased method to identify the most likely spectrum among a set obtained with different spectral parametrizations and imposed constraints. We demonstrate the power of this method with examples using imaginary-time data generated by QMC simulations and synthetic data generated from artificial spectra. Our procedure, which can be considered a form of model selection, can be applied to a variety of numerical analytic continuation methods, beyond just SAC.
We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.
A method for analytic continuation of imaginary-time correlation functions (here obtained in quantum Monte Carlo simulations) to real-frequency spectral functions is proposed. Stochastically sampling a spectrum parametrized by a large number of δ functions, treated as a statistical-mechanics problem, it avoids distortions caused by (as demonstrated here) configurational entropy in previous sampling methods. The key development is the suppression of entropy by constraining the spectral weight to within identifiable optimal bounds and imposing a set number of peaks. As a test case, the dynamic structure factor of the S=1/2 Heisenberg chain is computed. Very good agreement is found with Bethe ansatz results in the ground state (including a sharp edge) and with exact diagonalization of small systems at elevated temperatures.
A data-science approach to solving the ill-conditioned inverse problem for analytical continuation is proposed. The root of the problem lies in the fact that even tiny noise of imaginary-time input data has a serious impact on the inferred real-frequency spectra. By means of a modern regularization technique, we eliminate redundant degrees of freedom that essentially carry the noise, leaving only relevant information unaffected by the noise. The resultant spectrum is represented with minimal bases and thus a stable analytical continuation is achieved. This framework further provides a tool for analyzing to what extent the Monte Carlo data need to be accurate to resolve details of an expected spectral function.
Many fields of physics use quantum Monte Carlo (QMC) simulations to simulate quantum systems in imaginary-time τττ and estimate imaginary-time correlation functions (ITCF). However, extracting dynamic ωωω-dependent quantities from ITCFs is a notoriously difficult task, known as analytic continuation (AC), that amounts to solving an exponentially ill-conditioned inverse problem. Within the AC literature, there are competing stochastic and regularized approaches, as well as an emerging collection of works using parameterized models like neural networks. Here we transcend the traditional divides between the communities, introducing the regularized stochastic optimization method (RSOM). This method reformulates AC as a dictionary learning problem, discovering a sparse dictionary to represent the solution. Our approach is motivated by the astounding results dictionary learning has produced in many scientific fields. Remarkably, RSOM discovers a sparse dictionary that maps an ill-conditioned inverse problem to a low-dimensional problem that is well-conditioned. We demonstrate that the method yields competitive results for common synthetic test problems as well as for authentic QMC data from the finite temperature electron gas. This work exposes that a dictionary exists within all stochastic and regularized methods and that dictionary learning provides a new angle of attack for future AC methods.
An outstanding problem in the simulation of condensed-matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary-time quantum Monte Carlo data to obtain real-frequency spectral functions. This is an extremely ill-posed problem similar to the inversion of a Laplace transform. We suggest an image-reconstruction approach, which has been widely applied to data analysis in experimental research. Specifically, we apply the maximum-entropy method (ME) to the analytic continuation of quantum Monte Carlo data. We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We compare (ME) to alternative methods. We also discuss statistical error propagation for the analytic continuation problem via the likelihood function, which is independent of the choice of image-reconstruction method. This includes the sensitivity of the data to structure in the spectral function, the optimization of Monte Carlo simulations, and how to incorporate covariance in the statistical errors of the Monte Carlo method.
The Quantum Monte Carlo (QMC) method can yield the imaginary-time dependence of a correlation function C(τ)C(τ)C(τ) of an operator O^\hat OO^. The analytic continuation to real-time proceeds by means of a "numerical inversion" of these data to find the response function or spectral density A(ω)A(ω)A(ω) corresponding to O^\hat OO^. Such a technique is very sensitive to the statistical errors in C(τ)C(τ)C(τ) especially for large values of τττ, when we are interested in the low-energy excitations. In this paper, we find that if we use the flat histogram technique in the QMC method, in such a way to make the {\it histogram of} C(τ)C(τ)C(τ) flat, the results of the analytic continuation for low-energy excitations improve using the same amount of computational time. To demonstrate the idea we select an exactly soluble version of the single-hole motion in the t−Jt-Jt−J model and the diagrammatic Monte Carlo technique.