IEEE Transactions on Automatic Control, Vol.44, No.12, 2271-2282, 1999
On nearly optimal controls of hybrid LQG problems
This paper is concerned with hybrid control of a class of linear quadratic Gaussian (LQG) systems modulated by a finite-state Markov chain. It develops approximation schemes for systems involving singularly perturbed Markov chains with weak and strong interactions, which are useful for natural timescale separation and for large-scale Markovian systems, The presentation encompasses three cases: the recurrent Markov chains, inclusion of transient states, and inclusion of absorbing states. Near optimality of the approximation schemes is obtained, and a numerical example is presented, Computational results indicate our approximation schemes perform well.