Hi I was just wondering why the examiners report said something along the lines of "students incorrectly calculated the stationary dist..." I calculated the long run dist and obtained 9/113 and 4/113 as the prob of being in states game A and game B respectively. The prob of A winning was therefore 9/(9+4) = 9/13 = 0.6923 which is almost identical to the solutions given (under a completely diff method) Is this a pure coincidence? Thanks in advance!
Yeah I think it is just coincidence. I think that the markov chain isn't aperiodic or irreducible right? So this might not be unique or it might not converge to this in this over a number of games.
