Markov Chain

Dive into a comprehensive 90-minute tutorial on Markov Chains, exploring transition diagrams, steady states, regular and absorbing Markov chains. Learn through a structured progression, starting with fundamental concepts and advancing to applied problems. Examine the standard form for absorbing Markov chains and investigate limiting matrices. Gain a thorough understanding of this powerful mathematical tool used in various fields such as computer science, physics, and economics.

Syllabus

Markov Chains - Part 1.
Markov Chains, Part 2.
Markov Chains, Part 3 - Regular Markov Chains.
Markov Chains , Part 4.
Markov Chains, Part 5.
Markov Chains - Part 6 - Applied Problem for Regular Markov Chains.
Markov Chains - Part 7 - Absorbing Markov Chains and Absorbing States.
Markov Chains - Part 8 - Standard Form for Absorbing Markov Chains.
Markov Chains - Part 9 - Limiting Matrices of Absorbing Markov Chains.