Courses with significant overlap with this course:

Semester of last offering:

Date of approval: dd-mmm-yyyy

Prerequisites: 

Course Contents

Definition and classification of general stochastic processes. Markov Chains: definition, transition probability matrices, classification of states, limiting properties. Markov Chains with Discrete State Space: Poisson process, birth and death processes. Renewal Process: renewal equation, mean renewal time, stopping time. Markov Process with Continuous State Space: Introduction to Brownian motion.