I think you'll need to be more specific about your issues before someone is able to help you. Which solutions are you looking at? Which particular steps in it don't you understand? Note that this is quite an unusual question on Markov chains, of a type that rarely appears on the exam. If you're just starting to practise questions, it may be best to look at others first (which you may find more approachable) to put this one into context. You could then return to this one later.
