This thesis describes experiments which investigate ultracold atom \nensembles in an optical lattice. Such quantum gases are powerful models for solid state physics. Several novel methods are demonstrated that probe the special properties of strongly correlated states in lattice potentials. Of these, quantum noise spectroscopy reveals spatial correlations in such states, which are hidden when using the usual methods of probing atomic gases. Another spectroscopic technique makes it possible to demonstrate the existence of a shell structure of regions with constant densities. Such coexisting phases separated by sharp boundaries had been theoretically predicted for the Mott insulating state.\nThe tunneling processes in the optical lattice in the strongly correlated regime are probed by preparing the ensemble in an optical superlattice potential. This allows the time-resolved observation of the tunneling dynamics, and makes it possible to directly identify correlated tunneling processes.\n