The author develops the necessary background in probability theory and Markov chains then discusses important computing applications. von H. Ggstr M., Olle;Haggstrom, Olle;Olle, Haggstrom;