We derive an expression for the reduced density matrices of ideal Bose and Fermi gases in the canonical ensemble, which corresponds to the Bloch--De Dominicis (or Wick's) theorem in the grand canonical ensemble for normal-ordered products of operators. Using this expression, we study one- and two-body correlations of homogeneous ideal gases with
N particles. The pair distribution function
g(2)(r) of fermions clearly exhibits antibunching with
g(2)(0)=0 due to the Pauli exclusion principle at all temperatures, whereas that of normal bosons shows bunching with
g(2)(0)≈2, corresponding to the Hanbury Brown--Twiss effect. For bosons below the Bose--Einstein condensation temperature
T0, an off-diagonal long-range order develops in the one-particle density matrix to reach
g(1)(r)=1 at
T=0, and the pair correlation starts to decrease towards
g(2)(r)≈1 at
T=0. The results for
N→∞ are seen to converge to those of the grand canonical ensemble obtained by assuming the average
⟨ψ^(r)⟩ of the field operator
ψ^(r) below
T0. This fact justifies the introduction of the "anomalous" average
⟨ψ^(r)⟩=0 below
T0 in the grand canonical ensemble as a mathematical means of removing unphysical particle-number fluctuations to reproduce the canonical results in the thermodynamic limit.
Many experimentally accessible, finite-sized interacting quantum systems are most appropriately described by the canonical ensemble of statistical mechanics. Conventional numerical simulation methods either approximate them as being coupled to a particle bath or use projective algorithms which may suffer from nonoptimal scaling with system size or large algorithmic prefactors. In this paper, we introduce a highly stable, recursive auxiliary field quantum Monte Carlo approach that can directly simulate systems in the canonical ensemble. We apply the method to the fermion Hubbard model in one and two spatial dimensions in a regime known to exhibit a significant "sign" problem and find improved performance over existing approaches including rapid convergence to ground-state expectation values. The effects of excitations above the ground state are quantified using an estimator-agnostic approach including studying the temperature dependence of the purity and overlap fidelity of the canonical and grand canonical density matrices. As an important application, we show that thermometry approaches often exploited in ultracold atoms that employ an analysis of the velocity distribution in the grand canonical ensemble may be subject to errors leading to an underestimation of extracted temperatures with respect to the Fermi temperature.