Automatica, Vol.48, No.8, 1825-1832, 2012
Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, the implementation of the iterative algorithm via globalized dual heuristic programming technique is presented by using three neural networks, which will approximate at each iteration the cost function, the control law, and the unknown nonlinear system, respectively. In addition, two simulation examples are provided to verify the effectiveness of the developed optimal control approach. (C) 2012 Elsevier Ltd. All rights reserved.
Keywords:Adaptive critic designs;Adaptive dynamic programming;Approximate dynamic programming;Globalized dual heuristic programming;Intelligent control;Neural network;Optimal control