Sign problem in quantum Monte Carlo (QMC) simulation appears to be an extremely hard yet interesting problem. In this article, we present a pedagogical overview on the origin of the sign problem in various quantum Monte Carlo simulation techniques, ranging from the world-line and stochastic series expansion Monte Carlo for boson and spin systems to the determinant and momentum-space quantum Monte Carlo for interacting fermions. We point out the basis dependency of the sign problem and summarize the progresses to cure, ease and even make use of the sign problem over the years, such as symmetry analysis of the underlying Hamiltonian, basis optimization in writting down the partition functions and many others. Moreover, we state that although traditional lore saying that in case of sign problem, the average sign in QMC simulation approaches zero exponentially fast with the space-time volume of the configurational space, there are recent breakthroughs showing this is not always the case and based on the properties of the partition function for finite size systems, one could distinguish when the average sign has the usual exponential scaling and when it is bestowed with an algebraic scaling at the low temperature limit. Fermionic QMC simulations with such algebraic sign problems have been successfully carried out for extended Hubbard-type and quantum Moiré lattice models.
Sign problem in quantum Monte Carlo (QMC) simulation appears to be an extremely hard yet interesting problem. In this article, we present a pedagogical overview on the origin of the sign problem in various quantum Monte Carlo simulation techniques, ranging from the world-line and stochastic series expansion Monte Carlo for boson and spin systems to the determinant and momentum-space quantum Monte Carlo for interacting fermions. We point out the basis dependency of the sign problem and summarize the progresses to cure, ease and even make use of the sign problem over the years, such as symmetry analysis of the underlying Hamiltonian, basis optimization in writting down the partition functions and many others. Moreover, we state that although traditional lore saying that in case of sign problem, the average sign in QMC simulation approaches zero exponentially fast with the space-time volume of the configurational space, there are recent breakthroughs showing this is not always the case and based on the properties of the partition function for finite size systems, one could distinguish when the average sign has the usual exponential scaling and when it is bestowed with an algebraic scaling at the low temperature limit. Fermionic QMC simulations with such algebraic sign problems have been successfully carried out for extended Hubbard-type and quantum Moiré lattice models.
Sign problems in fermion quantum Monte Carlo (QMC) simulation appears to be an extremely hard problem. Traditional lore passing around for years tells people that when there is a sign problem, the average sign in QMC simulation approaches zero exponentially fast with the space-time volume of the configurational space. We, however, analytically show this is not always the case and manage to find physical bounds for the average sign. Our understanding is based on a direct connection between the sign bounds and a well-defined partition function of the reference system and could distinguish when the bounds have the usual exponential scaling and when they are bestowed on an algebraic scaling at the low-temperature limit. We analytically explain such algebraic sign problems found in flat-band moir\'e lattice models at the low-temperature limit. At finite temperature, a domain-size argument based on sign bounds also explains the connection between sign behavior and finite-temperature phase transition. Sign bounds, as a well-defined observable, may have the ability to ease or even make use of the sign problem.
Determinant quantum Monte Carlo (QMC) simulations of fermion models normally face the sign problem, which has a strong dependence of the interaction strength, electron filling, temperature, lattice geometry and lattice size. It is useful to set up the data set of such dependence, to make it clear which parameter region is accessible or not. To supplement the previous study, here we report the behavior of the average sign in the weak interaction region, as functions of lattice geometry, lattice size, electron filling and temperature. Furthermore, we find that in the weak interaction region, for several interesting lattice geometries (except for the kagome lattice) the average sign gets improved when the lattice sizes increase, which is in contrast to the general understanding of the lattice size dependence of the average sign. This finding points out that when the sign problem is present in the weak interaction region, the simulation of a larger lattice size can be better under control.
Discussions of the sign problem usually focus on its role as the primary limitation of the applicability of quantum Monte Carlo methods for reliably solving quantum many-body models. Its behavior as a function of spatial lattice size, doping, temperature, and interaction strengths has been carefully characterized within the determinant quantum Monte Carlo algorithm. Here, we consider the much less well-explored question of the temperature- and size-dependence of the sign problem in the world-line quantum Monte Carlo method. We review how, in this algorithm, even sampling the partition function of free fermions yields a sign problem, which we connect to non-analytic behavior in the corresponding reference model, hard-core bosons on a lattice. The latter exhibits a finite-temperature Kosterlitz-Thouless phase transition in 2D, and we show how this non-analytic behavior is imprinted on the average sign of the weights for the corresponding free fermion 2D tight-binding model. Our results thus show how phase-transition information can remain encoded in the sign problem even after direct sign sampling becomes impractical.
Reliable simulations of correlated quantum systems, including high-temperature superconductors and frustrated magnets, are increasingly desired nowadays to further our understanding of essential features in such systems. Quantum Monte Carlo (QMC) is a unique numerically exact and intrinsically unbiased method to simulate interacting quantum many-body systems. More importantly, when QMC simulations are free from the notorious fermion sign problem, they can reliably simulate interacting quantum models with large system size and low temperature to reveal low-energy physics such as spontaneously broken symmetries and universal quantum critical behaviors. Here, we concisely review recent progress made in developing new sign-problem-free QMC algorithms, including those employing Majorana representation and those utilizing hot-spot physics. We also discuss applications of these novel sign-problem-free QMC algorithms in simulations of various interesting quantum many-body models. Finally, we discuss possible future directions of designing sign-problem-free QMC methods.
Quantum Monte Carlo simulations of quantum many-body systems are plagued by the Fermion sign problem. The computational complexity of simulating Fermions scales exponentially in the projection time β and system size. The sign problem is basis dependent and an improved basis, for fixed errors, leads to exponentially quicker simulations. We show how to use sign-free quantum Monte Carlo simulations to optimize over the choice of basis on large two-dimensional systems. We numerically illustrate these techniques decreasing the "badness" of the sign problem by optimizing over single-particle basis rotations on one- and two-dimensional Hubbard systems. We find a generic rotation which improves the average sign of the Hubbard model for a wide range of U and densities for L×4 systems. In one example improvement, the average sign (and hence simulation cost at fixed accuracy) for the 16×4 Hubbard model at U/t=4 and n=0.75 increases by exp[8.64(6)β]. For typical projection times of β⪆100, this accelerates such simulation by many orders of magnitude.
Understanding strongly correlated electrons is an important long-term goal, not only for uncovering fundamental physics behind, but also for their emergence of lots of novel states which have potential applications in quantum control and quantum computations. Meanwhile, the strongly correlated electrons are usually extremely hard problems, and it is generally impossible to understand them unbiasedly. Quantum Monte Carlo is a typical unbiased numeric method, which does not depend on any perturbation, and it can help us to exactly understand the strongly correlated electrons, so that it is widely used in high energy and condensed matter physics. However, quantum Monte Carlo usually suffers from the notorious sign problem. In this paper, we introduce general ideas to design sign problem free models and discuss the sign bound theory we proposed recently. In the sign bound theory, we build a direct connection between the average sign and the ground state properties of the system. We find usually the average sign has the conventional exponential decay with system size increasing, leading to exponential complexity; but for some cases it can have algebraic decay, so that quantum Monte Carlo simulation still has polynomial complexity. By designing sign problem free or algebraic sign behaved strongly correlated electron models, we can approach to several long outstanding problems, such as the itinerant quantum criticality, the competition between unconventional superconductivity and magnetism, as well as the recently found correlated phases and phase transitions in moiré quantum matter.