Hi, I was going through the 2nd revision booklet, and I'm a little confused about the questions that ask for the mean duration in a state or the expected time to get a state. The answer is usually : Ep = 1 + (prob. of staying in state p * Ep)... can someone help me understand why this is the formula for the expectation? Thanks.
hi. Have a look at my reply to maryam's thread that I posted today - it's about exactly the same question! (it's titled "Markov Chain".)