Jane Street interview question

probability question, and markov chain