Modeling, Analysis, Design, And Control Of Stochastic Systems

The book provides a self-contained review of the relevant topics in probability theory: In discrete and continuous time Markov models it covers the transient and long term behaviour, cost models, and first passage times;