A feedback control law, which is constructed as a first-order approximation to the optimal control, is proposed for nonlinear time-varying systems subject to continuous inequality constraints on the control and state. This control law is effective under small state perturbations caused by changes on initial conditions and/or modeling uncertainty. (C) 2012 Elsevier Ltd. All rights reserved.