You are Here: Home

# Markov chain help

Announcements Posted on
Fancy a fiver? Fill in our quick survey and we’ll send you a £5 Amazon voucher 03-05-2016
Talking about ISA/EMPA specifics is against our guidelines - read more here 28-04-2016
1. Just a quick couple of questions:
1
What is meant by the 'equilibrium distribution vector' concerning a Markov chain of probabilities?

Take this example:

1---------2----------3

"An object moves along the graph shown above, so that at each step it moves with equal probability to a neighbouring point."

a) Write down the transition matrix P for this Markov process (i think i've got this right, so i'm not bothered about this one)
b) Calculate the equilibrium distribution vector for this Markov process.

2
How do you calculate the limit as n -> infinity of A^n for a square matrix A?
2. From my rather hazy memory, an equilibrium (or invariant) distribution vector is a stochastic row vector with .
3. (Original post by generalebriety)
From my rather hazy memory, an equilibrium (or invariant) distribution vector is a stochastic row vector with .
Thanks, that makes sense now.
4. In general, finding is tricky (even assuming the limit exists).

But barring a few pathological cases(*), if M is a stochastic matrix, and is an invariant vector for M, then . Which means M^n converges to the matrix with all columns equal to .

(*) I think it always works as longs as M has no elements of size 1, but that's intuition and hope speaking rather than detailed knowledge.

## Register

Thanks for posting! You just need to create an account in order to submit the post
1. this can't be left blank
2. this can't be left blank
3. this can't be left blank

6 characters or longer with both numbers and letters is safer

4. this can't be left empty
1. Oops, you need to agree to our Ts&Cs to register

Updated: February 12, 2009
TSR Support Team

We have a brilliant team of more than 60 Support Team members looking after discussions on The Student Room, helping to make it a fun, safe and useful place to hang out.

This forum is supported by:
Today on TSR

### iGCSE English Language

Here's the unofficial markscheme

Poll
Useful resources

### Maths Forum posting guidelines

Not sure where to post? Read here first

### How to use LaTex

Writing equations the easy way

### Study habits of A* students

Top tips from students who have already aced their exams