In this paper the problem of shape optimization under shape constraints is investigated. Using the shape gradient and shape tangent cones, inverse function theorems are established. With these theorems, the existence of Lagrangian or Kuhn-Tucker multipliers for shape optimization problems with equality or inequality constraints is proved.