In this paper we present a sequel of [Fleming and Hernandez-Hernandez, SIAM J. Control Optim., 35 (1997), pp. 1790-1810], extending those results to discrete time, output feedback (partial state information) systems. Our aim is to study both robust and risk-sensitive control of such systems on an infinite horizon. Appropriate information states are defined for each case, and dynamic programming results are obtained.