Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1804.01683 · Physical review. B./Physical review. B

Maximum quantum entropy method

Jae-Hoon Sim, Myung Joon Han

Published Nov 1, 2018• 27 citations
arXivHTMLPDF

Abstract

A maximum entropy method for analytic continuation is extended by introducing quantum relative entropy. This method is formulated in terms of matrix-valued functions and therefore invariant under arbitrary unitary transformation of input matrix. As a result, the continuation of off-diagonal elements becomes straightforward. Without introducing any further ambiguity, the Bayesian probabilistic interpretation is maintained just as in the conventional maximum entropy method. The applications of our generalized formalism to a model spectrum and a real material demonstrate its usefulness and superiority.

DOI
10.1103/physrevb.98.205102

Related papers

Maximum entropy formalism for the analytic continuation of matrix-valued Green's functions

Gernot J. Kraberger, Robert Triebl, Manuel Zingl +1 more

We present a generalization of the maximum entropy method to the analytic continuation of matrix-valued Green's functions. To treat off-diagonal elements correctly based on Bayesian probability theory, the entropy term has to be extended for spectral functions that are possibly negative in some frequency ranges. In that way, all matrix elements of the Green's function matrix can be analytically continued; we introduce a computationally cheap element-wise method for this purpose. However, this method cannot ensure important constraints on the mathematical properties of the resulting spectral functions, namely positive semidefiniteness and Hermiticity. To improve on this, we present a full matrix formalism, where all matrix elements are treated simultaneously. We show the capabilities of these methods using insulating and metallic dynamical mean-field theory (DMFT) Green's functions as test cases. Finally, we apply the methods to realistic material calculations for ${\mathrm{LaTiO}}_{3}$, where off-diagonal matrix elements in the Green's function appear due to the distorted crystal structure.

arXiv:1705.08838•Physical review. B./Physical review. B•Oct 17, 2017•109 citations

Algorithms for optimized maximum entropy and diagnostic tools for analytic continuation

Dominic Bergeron, A.–M. S. Tremblay

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem. The maximum-entropy approach, based on Bayesian inference, is the most widely used method to tackle that problem. Although the approach is well established and among the most reliable and efficient ones, useful developments of the method and of its implementation are still possible. In addition, while a few free software implementations are available, a well-documented, optimized, general purpose, and user-friendly software dedicated to that specific task is still lacking. Here we analyze all aspects of the implementation that are critical for accuracy and speed and present a highly optimized approach to maximum entropy. Original algorithmic and conceptual contributions include (1) numerical approximations that yield a computational complexity that is almost independent of temperature and spectrum shape (including sharp Drude peaks in broad background, for example) while ensuring quantitative accuracy of the result whenever precision of the data is sufficient, (2) a robust method of choosing the entropy weight α that follows from a simple consistency condition of the approach and the observation that information- and noise-fitting regimes can be identified clearly from the behavior of χ^{2} with respect to α, and (3) several diagnostics to assess the reliability of the result. Benchmarks with test spectral functions of different complexity and an example with an actual physical simulation are presented. Our implementation, which covers most typical cases for fermions, bosons, and response functions, is available as an open source, user-friendly software.

arXiv:1507.01012•Physical review. E•Aug 5, 2016•118 citations

Progress on stochastic analytic continuation of quantum Monte Carlo data

Hui Shao, Anders W. Sandvik

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.

arXiv:2202.09870•Physics Reports•Dec 21, 2022•90 citations

Maximum-entropy method for analytic continuation of quantum Monte Carlo data

Richard N. Silver, Devinderjit Singh Sivia, James E. Gubernatis

An outstanding problem in the simulation of condensed-matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary-time quantum Monte Carlo data to obtain real-frequency spectral functions. This is an extremely ill-posed problem similar to the inversion of a Laplace transform. We suggest an image-reconstruction approach, which has been widely applied to data analysis in experimental research. Specifically, we apply the maximum-entropy method (ME) to the analytic continuation of quantum Monte Carlo data. We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We compare (ME) to alternative methods. We also discuss statistical error propagation for the analytic continuation problem via the likelihood function, which is independent of the choice of image-reconstruction method. This includes the sensitivity of the data to structure in the spectral function, the optimization of Monte Carlo simulations, and how to incorporate covariance in the statistical errors of the Monte Carlo method.

Physical review. B, Condensed matter•Feb 1, 1990•306 citations

Maximum quantum entropy method: the analytic continuation of matrix-valued Green's functions

Jae-Hoon Sim, Myung Joon Han

APS•Jan 1, 2019•0 citations

Bayesian generalized probability calculus for density matrices

Manfred K. Warmuth, Dima Kuzmin

One of the main concepts in quantum physics is a density matrix, which is a symmetric positive definite matrix of trace one. Finite probability distributions can be seen as a special case when the density matrix is restricted to be diagonal. We develop a probability calculus based on these more general distributions that includes definitions of joints, conditionals and formulas that relate these, including analogs of the Theorem of Total Probability and various Bayes rules for the calculation of posterior density matrices. The resulting calculus parallels the familiar “conventional” probability calculus and always retains the latter as a special case when all matrices are diagonal. We motivate both the conventional and the generalized Bayes rule with a minimum relative entropy principle, where the Kullbach-Leibler version gives the conventional Bayes rule and Umegaki’s quantum relative entropy the new Bayes rule for density matrices. Whereas the conventional Bayesian methods maintain uncertainty about which model has the highest data likelihood, the generalization maintains uncertainty about which unit direction has the largest variance. Surprisingly the bounds also generalize: as in the conventional setting we upper bound the negative log likelihood of the data by the negative log likelihood of the MAP estimator.

arXiv:0901.1273•Machine Learning•Jul 22, 2009•32 citations
A maximum entropy method for analytic continuation is extended by introducing quantum relative entropy. This method is formulated in terms of matrix-valued functions and therefore invariant under arbitrary unitary transformation of input matrix. As a result, the continuation of off-diagonal elements becomes straightforward. Without introducing any further ambiguity, the Bayesian probabilistic interpretation is maintained just as in the conventional maximum entropy method. The applications of our generalized formalism to a model spectrum and a real material demonstrate its usefulness and superiority.
We present a generalization of the maximum entropy method to the analytic continuation of matrix-valued Green's functions. To treat off-diagonal elements correctly based on Bayesian probability theory, the entropy term has to be extended for spectral functions that are possibly negative in some frequency ranges. In that way, all matrix elements of the Green's function matrix can be analytically continued; we introduce a computationally cheap element-wise method for this purpose. However, this method cannot ensure important constraints on the mathematical properties of the resulting spectral functions, namely positive semidefiniteness and Hermiticity. To improve on this, we present a full matrix formalism, where all matrix elements are treated simultaneously. We show the capabilities of these methods using insulating and metallic dynamical mean-field theory (DMFT) Green's functions as test cases. Finally, we apply the methods to realistic material calculations for LaTiO3{\mathrm{LaTiO}}_{3}LaTiO3​, where off-diagonal matrix elements in the Green's function appear due to the distorted crystal structure.
Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem. The maximum-entropy approach, based on Bayesian inference, is the most widely used method to tackle that problem. Although the approach is well established and among the most reliable and efficient ones, useful developments of the method and of its implementation are still possible. In addition, while a few free software implementations are available, a well-documented, optimized, general purpose, and user-friendly software dedicated to that specific task is still lacking. Here we analyze all aspects of the implementation that are critical for accuracy and speed and present a highly optimized approach to maximum entropy. Original algorithmic and conceptual contributions include (1) numerical approximations that yield a computational complexity that is almost independent of temperature and spectrum shape (including sharp Drude peaks in broad background, for example) while ensuring quantitative accuracy of the result whenever precision of the data is sufficient, (2) a robust method of choosing the entropy weight α that follows from a simple consistency condition of the approach and the observation that information- and noise-fitting regimes can be identified clearly from the behavior of χ^{2} with respect to α, and (3) several diagnostics to assess the reliability of the result. Benchmarks with test spectral functions of different complexity and an example with an actual physical simulation are presented. Our implementation, which covers most typical cases for fermions, bosons, and response functions, is available as an open source, user-friendly software.
We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. After reviewing the conventional maximum-entropy approach and established stochastic analytic continuation methods, we present several new developments in which the configurational entropy of the sampled spectrum plays a key role. Parametrizing the spectrum as a large number of δ-functions in continuous frequency space, an exact calculation of the entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. We also compare spectra sampled in continuous frequency with those from amplitudes sampled on a fixed frequency grid. Insights into the functional form of the entropy in different cases allow us to demonstrate equivalence in a generalized thermodynamic limit (large number of degrees of freedom) of the average spectrum and the maximum-entropy solution, with different parametrizations corresponding to different forms of the entropy in the prior probability. These results revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasi-particle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectra with sharp edge features at unprecedented fidelity. We present results for S=1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as “pre processors” for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level in many applications.
An outstanding problem in the simulation of condensed-matter phenomena is how to obtain dynamical information. We consider the numerical analytic continuation of imaginary-time quantum Monte Carlo data to obtain real-frequency spectral functions. This is an extremely ill-posed problem similar to the inversion of a Laplace transform. We suggest an image-reconstruction approach, which has been widely applied to data analysis in experimental research. Specifically, we apply the maximum-entropy method (ME) to the analytic continuation of quantum Monte Carlo data. We report encouraging preliminary results for the Fano-Anderson model of an impurity state in a continuum. The incorporation of additional prior information, such as sum rules and asymptotic behavior, can be expected to significantly improve results. We compare (ME) to alternative methods. We also discuss statistical error propagation for the analytic continuation problem via the likelihood function, which is independent of the choice of image-reconstruction method. This includes the sensitivity of the data to structure in the spectral function, the optimization of Monte Carlo simulations, and how to incorporate covariance in the statistical errors of the Monte Carlo method.
One of the main concepts in quantum physics is a density matrix, which is a symmetric positive definite matrix of trace one. Finite probability distributions can be seen as a special case when the density matrix is restricted to be diagonal. We develop a probability calculus based on these more general distributions that includes definitions of joints, conditionals and formulas that relate these, including analogs of the Theorem of Total Probability and various Bayes rules for the calculation of posterior density matrices. The resulting calculus parallels the familiar “conventional” probability calculus and always retains the latter as a special case when all matrices are diagonal. We motivate both the conventional and the generalized Bayes rule with a minimum relative entropy principle, where the Kullbach-Leibler version gives the conventional Bayes rule and Umegaki’s quantum relative entropy the new Bayes rule for density matrices. Whereas the conventional Bayesian methods maintain uncertainty about which model has the highest data likelihood, the generalization maintains uncertainty about which unit direction has the largest variance. Surprisingly the bounds also generalize: as in the conventional setting we upper bound the negative log likelihood of the data by the negative log likelihood of the MAP estimator.