SIAM Journal on Control and Optimization, Vol.58, No.4, 2312-2331, 2020
ON ITERATION IMPROVEMENT FOR AVERAGED EXPECTED COST CONTROL FOR ONE-DIMENSIONAL ERGODIC DIFFUSIONS
An ergodic Bellman's (Hamilton-Jacobi-Bellman) equation is proved for a uniformly ergodic one-dimensional controlled diffusion with variable diffusion and drift coefficients both depending on control; convergence of the values provided by Howard's reward improvement algorithm to the value which is a component of the unique solution of Bellman's equation is established.
Keywords:controlled diffusion processes;averaged expected control;Hamilton-Jacobi-Bellman equation;existence and uniqueness;reward improvement algorithm