SIAM Journal on Control and Optimization, Vol.39, No.5, 1540-1557, 2001
Pathwise optimality in stochastic control
We introduce a notion of pathwise optimality for stochastic control problems over an infinite time horizon, and give sufficient conditions for the existence of pathwise optimal controls. We analyze both diffusion processes and processes with discrete state space.