The Hubbard model at finite chemical potential is a cornerstone for understanding doped correlated systems, but simulations are severely limited by the sign problem. In the auxiliary-field formulation, the spin basis mitigates the sign problem, yet severe ergodicity issues have limited its use. We extend recent advances with normalizing flows at half-filling to finite chemical potential by introducing an annealing scheme enabling ergodic sampling. Compared to state-of-the-art hybrid Monte Carlo in the charge basis, our approach accurately reproduces exact diagonalization results while reducing statistical uncertainties by an order of magnitude, opening a new path for simulations of doped correlated systems.
The Hubbard model at finite chemical potential is a cornerstone for understanding doped correlated systems, but simulations are severely limited by the sign problem. In the auxiliary-field formulation, the spin basis mitigates the sign problem, yet severe ergodicity issues have limited its use. We extend recent advances with normalizing flows at half-filling to finite chemical potential by introducing an annealing scheme enabling ergodic sampling. Compared to state-of-the-art hybrid Monte Carlo in the charge basis, our approach accurately reproduces exact diagonalization results while reducing statistical uncertainties by an order of magnitude, opening a new path for simulations of doped correlated systems.
Understanding strongly correlated electron systems remains one of the central challenges in condensed matter physics. Finding ab initio descriptions of non-perturbative systems is of great importance for modeling carbon-based materials such as graphene or fullerenes. In this regime, computational methods become indispensable tools for performing simulations, making predictions, and ultimately comparing to experiments. The Hubbard model offers a minimal description of the dynamics of electrons in such materials. As exact methods are limited to small system sizes by the exponentially growing Hilbert space, larger-scale first-principle studies rely on numerical approaches. Alongside powerful Hamiltonian-based methods, the auxiliary-field description of the model offers a natural setting for Lagrangian-based Monte Carlo sampling. However, substantial challenges, such as lack of ergodicity and the numerical sign problem, arise in these approaches, leading to long autocorrelation times, biased results, and large statistical uncertainties. In recent years, generative models, especially normalizing flows, have been applied extensively to various theories to address shortcomings of traditional Monte Carlo-based algorithms, such as critical slowing down or topological freezing. While these approaches have shown promise in alleviating these issues, a poorly understood and unfavorable scaling of these methods has stalled their progress, and whether they can reach state-of-the-art system sizes in lattice quantum chromodynamics remains to be seen. This motivates the application of these methods to condensed matter systems, where physically relevant system sizes are reachable at substantially smaller scales. In this work, we study for the first time the application of generative models to the finite-temperature auxiliary-field Hubbard model. We begin by employing an equivariant normalizing flow that respects multiple symmetries inherent to the Boltzmann distribution, demonstrating a substantial improvement in sampling efficiency over Hybrid Monte Carlo and standard non-equivariant flows. We further develop Symmetry-Enforcing Stochastic Modulation (SESaMo), a more scalable algorithm capable of modeling both exact and broken symmetries in normalizing flows, and show that it achieves significantly higher effective sample sizes than traditional equivariant techniques at large system sizes. Equipped with SESaMo, we compute physical observables at half-filling in excellent agreement with exact diagonalization at substantially lower computational cost than Hybrid Monte Carlo. We then turn to the doped Hubbard model, where the theory exhibits a numerical sign problem. We introduce an annealing scheme to simulate the Hubbard model at finite chemical potential in the spin basis. Making use of the less severe sign problem in this description, the annealing scheme enables ergodic sampling of the multi-modal distribution, yielding more accurate results with substantially reduced uncertainties compared to state-of-the-art optimized Hybrid Monte Carlo. Lastly, we employ a masked autoencoder for distribution estimation to learn the Boltzmann distribution of the discrete auxiliary-field Hubbard model. Preliminary results show a significantly higher effective sample size compared to normalizing flows with continuous degrees of freedom, while also exhibiting a milder sign problem than the continuous spin basis.
We study the sign problem in the Hubbard model on the hexagonal lattice away from half-filling using the Lefschetz thimbles method. We identify the saddle points, reduce their amount, and perform quantum Monte Carlo (QMC) simulations using the holomorphic gradient flow to deform the integration contour in complex space. Finally, the results are compared against exact diagonalization (ED). We show that the sign problem can be substantially weakened, even in the regime with low temperature and large chemical potential, where standard QMC techniques exhibit an exponential decay of the average sign.
Understanding the properties of strongly correlated materials is a tough work since most of the times analytical tools cannot be applied due to the complicated nature of the problem. Here we apply quantum Monte Carlo techniques in order to tackle with one of the most important and unknown phenomena of many materials: the mechanism of superconductivity. We study the Hubbard-Holstein model which is one of the most simple theoretical models including strong correlation and electron-phonon coupling. By using twist-averaging boundary conditions we eliminate finite-size errors in the Monte Carlo simulations. With this useful tool we first solve the Hubbard-Holstein model by variational Monte Carlo by reporting the phase diagram of the model for different phonon frequencies at half filling. Then we investigate the phase separation away from half filling. Finally we try to attack the problem with an essentially unbiased method based on the auxiliary field quantum Monte Carlo technique and accelerated Langevin dynamics. By curing the sign problem via Cauchy integration in the complex plane where the auxiliary fields have been defined, we report the effect of the electron-phonon coupling on some observables such as magnetization, spin and charge structure factors. We show preliminary results that are already meaningful to understand the nature of the transition between magnetism and charge order in the model at half filling.
We present the first proof of principle that normalizing flows can accurately learn the Boltzmann distribution of the fermionic Hubbard model—a key framework for describing the electronic structure of graphene and related materials. State-of-the-art methods like hybrid Monte Carlo often suffer from ergodicity issues near the time-continuum limit, leading to biased estimates. Leveraging symmetry-aware architectures as well as independent and identically distributed sampling, our approach resolves these issues and achieves significant speedups over traditional methods.
Generative models, particularly normalizing flows, have shown exceptional performance in learning probability distributions across various domains of physics, including statistical mechanics, collider physics, and lattice field theory. In the context of lattice field theory, normalizing flows have been successfully applied to accurately learn the Boltzmann distribution, enabling a range of tasks such as direct estimation of thermodynamic observables and sampling independent and identically distributed (i.i.d.) configurations. In this work, we present a proof-of-concept demonstration that normalizing flows can be used to learn the Boltzmann distribution for the Hubbard model. This model is widely employed to study the electronic structure of graphene and other carbon nanomaterials. State-of-the-art numerical simulations of the Hubbard model, such as those based on Hybrid Monte Carlo (HMC) methods, often suffer from ergodicity issues, potentially leading to biased estimates of physical observables. Our numerical experiments demonstrate that leveraging i.i.d. sampling from the normalizing flow effectively addresses these issues.
The Hubbard model offers a powerful minimal description of strongly correlated electrons in molecules and materials, yet it neglects effects observed in nature that give rise to a much richer variety of physics. For instance, including nonlocal interactions introduces a competition between strongly correlated phases, while incorporating spin-orbit coupling (SOC) can lead to the emergence of exotic topological phases. Seeking a more realistic platform for simulating graphene and, potentially, related materials such as transition metal dichalcogenides (TMDs), we therefore consider the extended Kane-Mele-Hubbard model, which features a Kane-Mele SOC term and nearest-neighbor interactions. Simulating this model is particularly challenging once the nonlocal interactions become dominant over the on-site Hubbard interaction, as a severe sign problem arises already at half filling, leaving this regime largely unexplored. In this work, we develop continuous auxiliary field formulations of the model, suitable for treatment with the Hybrid Monte Carlo (HMC) algorithm. Using these formulations, we characterize the sign problem across the model's parameter space and establish where simulations are feasible, as a first step toward the full phase diagram.