Hi In the ques on pg 18 of Ch 1 as per 2019 acted material ,how is the process Markov? Since Xt depends on the past value i:e X t-1 and also the probabilties are dependent on X t-1 so the process doesnt appear Markov to me. Pls explain
Hi For a process to be Markov, we need only know the current value of the process to predict its future states. Therefore even though the current value of the process depends on the past values, the path that the process took to reach the current value does not affect the probabilities of future states. In the example give, let's say Xt = 1, then Xt+1 can be either 0 or 2, and we only need to know that Xt = 1 to calculate the probabilities for Xt+1. Dave
