This thesis presents a series of experimental studies that leverage atom-resolved imaging to probe fundamental properties of ultracold Fermi gases in continuous space. We demonstrate the viability of this continuum microscopy by reliably observing the expansion of a Gaussian wave packet and the Fermi hole of a two-dimensional ideal Fermi gas, measuring its second- and third-order correlation functions. Building upon this foundation, we introduce a novel local thermometer based on the relationship between fluctuations and correlations. This method enables accurate global and local temperature measurement without requiring trap calibration. Further investigations reveal sub-extensive fluctuations absent from the well-known fluctuation-dissipation theorem. We describe how these fluctuations are linked to entanglement entropy and observe a violation of the area law. Following this we connect the spatial organization of non-interacting fermions to random matrix theory via the Fredholm determinant. Measurements of the counting statistics and nearest-neighbor spacing are compared with numerical predictions, showing excellent agreement. Finally, we explore the physics of two-dimensional interacting fermions in the BEC-BCS crossover. Our measurements of two- and three-point correlation functions show significant discrepancies with mean-field BCS theory, but are corroborated by exact quantum Monte Carlo calculations. We also perform a precise measurement of Tan's contact. As a whole, this work provides a unique and unprecedented microscopic perspective on the fundamentals of Fermi gases, and establishes quantum gas microscopy as a powerful and versatile tool for exploring quantum gases in the continuum.