This chapter contains sections titled: Markovian Stochastic Processes The Master Equation One-Step Processes in Finite Systems The First-Passage Time Problem The Poisson Process in Closed and Open Systems The Two-Level System The Three-Level System Exercises