Sheldon M Ross Stochastic Process 2nd Edition Solution 📍

4.3. Consider a Markov chain with states 0, 1, and 2, and transition probability matrix:

Autocov(t, s) = E[(X(t) - E[X(t)]) (X(s) - E[X(s)])] = E[X(t)X(s)] = E[(A cos(t) + B sin(t))(A cos(s) + B sin(s))] = E[A^2] cos(t) cos(s) + E[B^2] sin(t) sin(s) = cos(t) cos(s) + sin(t) sin(s) = cos(t-s) Sheldon M Ross Stochastic Process 2nd Edition Solution

2.1. Let X be a random variable with probability density function (pdf) f(x) = 2x, 0 ≤ x ≤ 1. Find E[X] and Var(X). and transition probability matrix: Autocov(t

Var(X) = E[X^2] - (E[X])^2 = ∫[0,1] x^2(2x) dx - (2/3)^2 = ∫[0,1] 2x^3 dx - 4/9 = (1/2)x^4 | [0,1] - 4/9 = 1/2 - 4/9 = 1/18 Sheldon M Ross Stochastic Process 2nd Edition Solution