We formulate a model of hysteresis of Madelung type, and we study an optimal control problem associated with dynamical systems that include this type of hysteresis. We obtain and analyse a variant of dynamic programming equations for the solution of this optimal control problem.