the transition probability matrix of a markov chain xn n 1 2 3 having three 01 05 04 states 1 2 and 3 is p 06 02 02 and the initial state distribution is 03 04 03 po 07 02 01 find i pxz 3 ii 05705

3 a transition probability matrix p is said to be doubly stochastic if the sum over each column equals one that is ei pij 1 for all j if such a chain is irreducible and consists of ml state 09882