3.4 Markov Chains » Quiz #21 Solution
From the information given in the problem, it follows that the stochastic/transition matrix is: . Note that the columns sum to 1, as required. Furthermore, we observe that the P matrix is additionally 'regular', which indicates the existence of a unique, steady-state vector corresponding with P. In order to find the steady state vector v, we solve the system for the vector v. The result is .