Discrete-time Markov Chains

Focuses on the theory and applications of discrete-time two-time-scale Markov chains. This book presents results including asymptotic expansions of probability vectors, properties of occupation measures, exponential bounds, aggregation and decomposition and associated limit processes, and interface of discrete-time and continuous-time systems.