Applied Mathematics and Optimization, Vol.56, No.3, 379-394, 2007
A trust region method for optimization problem with singular solutions
In this paper, we propose a trust region method for minimizing a function whose Hessian matrix at the solutions may be singular. The global convergence of the method is obtained under mild conditions. Moreover, we show that if the objective function is LC2 function, the method possesses local superlinear convergence under the local error bound condition without the requirement of isolated nonsingular solution. This is the first regularized Newton method with trust region technique which possesses local superlinear (quadratic) convergence without the assumption that the Hessian of the objective function at the solution is nonsingular. Preliminary numerical experiments show the efficiency of the method.
Keywords:nonlinear convex optimization;trust region method;local error bound;superlinear convergence;nonsingularity