SIAM Journal on Control and Optimization, Vol.58, No.6, 3262-3292, 2020
ANALYSIS OF OPTIMAL CONTROL PROBLEMS FOR HYBRID SYSTEMS WITH ONE STATE VARIABLE
We study a class of discounted autonomous infinite horizon optimal control problems where the state dynamics may undergo discontinuous changes when the state crosses from one region of the state space to another. Assuming the state and control space are one-dimensional, we provide structural results of the candidate optimal solutions. In particular, we show that candidate optimal state trajectories are monotonic. Further, we prove a theorem on absence of limit cycles, generalizing the Bendixson criterion to a hybrid context. Using these results, we derive necessary and sufficient conditions for the existence of tipping points for this class of problems. A tipping point is an initial condition starting from which there exist multiple candidate optimal solutions with different qualitative behaviors. Next, we specialize these results for piecewise linear quadratic models to obtain an analytic characterization of tipping points in terms of the model parameters.
Keywords:regime switching models;hybrid systems;infinite horizon optimal control;multiple equilibria;tipping points