Hi Rajat,
Can you please post questions on different topics as different posts? It's more helpful if people want to follow the trail of one of the questions.
Whilst a share price is theoretically the discounted value of all future dividends, we're not going to always get this right. However, Shiller's point was that whilst we might get it wrong (forecast error), we should not systematically get it wrong in the same way. This suggests we are systematically over-estimating or under-estimating the price.
Markov and Martingale are not really connected...
Markov means where go next depends at most on where we are now.
Any process with independent increments has the Markov property, eg Brownian motion.
Martingale means that we expect the future value to be the current value.
Standard Brownian motion has the Markov property and is a martingale.
General Brownian motion with drift has the Markov property and is NOT a martingale.
Let Xn = Xn-1 + Zn X0, where Zn ~ N(a,1)
This is NOT Markov because where we go next, Xn, depends not just on where we are now, Xn-1, but also on where we were in the past, X0.
If a=0, Xn is a martingale
If a <>0, Xn is not a martingale.
So, we have created a 2*2 grid here of Markov/NOT Markov versus Martingale/NOT Martingale.
Good luck!
John