Just a quick couple of questions: 1
What is meant by the 'equilibrium distribution vector' concerning a Markov chain of probabilities?
Take this example:
"An object moves along the graph shown above, so that at each step it moves with equal probability to a neighbouring point."
a) Write down the transition matrix P for this Markov process (i think i've got this right, so i'm not bothered about this one)
b) Calculate the equilibrium distribution vector for this Markov process.
How do you calculate the limit as n -> infinity of A^n for a square matrix A?