Stochastic Processes

Discusses the modeling and analysis of random experiments using the theory of probability. This book focuses on the way in which the results or outcomes of experiments vary and evolve over time. It begins with a review of relevant fundamental probability. It then covers several basic gambling problems, random walks, and Markov chains.