Markov Chain Lab

MATH 2270 · Day 34 · Anton §5.5Markov Chain Lab

After0 hours

Each dot is one passenger. Every hour, each passenger rolls the dice using the column of P for where they are now. The bars show the exact probability vector xk = P xk−1; the dot counts show one random crowd following it.

Transition matrix P · columns = from, rows = to

Starting vector x₀

Probability over time

State vectors xk

HourPoolBuffetTheater