In this correspondence the continuity of the solution of the differential and algebraic Riccati equations for a continuous-time, Markovian, jump linear quadratic control problem as a function of coefficients is verified. The assumptions for this are stochastic stabilizability and observability.