IEEE Transactions on Automatic Control, Vol.41, No.12, 1814-1817, 1996
A Single-Sample Path-Based Performance Sensitivity Formula for Markov-Chains
Using a sample path approach, we derive a new formula for performance sensitivities of discrete-time Markov chains, A distinguished feature of this formula is that the quantities involved can be estimated by analyzing a single sample path of a Markov chain, Thus, the formula provides a new direction for sensitivity analysis and can be viewed as an extension of the perturbation realization theory to problems where infinitesimal perturbation analysis does not work well.