This course will introduce some basic methodologies in stochastic models, with an emphasis on engineering applications. Topics covered include probability and statistics basics, discrete-time Markov chains and processes; exponential distribution and the Poisson process; other Point processes; Renewal processes, Renewal reward theorem; continuous-time Markov chains; introduction to martingales and applications; introduction to Brownian motion.