You find a series of exercises with solutions that will help you to well understand Markov chains and classifications of states as well as some applications on the Blackboard plate form https://lms.ksu.edu.sa (Merged Math 380)