This paper investigates a mixed leader-follower differential games problem, where the model involves two players with the same hierarchy in decision making and each player has two controls which act as a leader and a follower, respectively. Specifically, we solve a follower problem with unconstrained controls and obtain the corresponding Nash equilibrium. Then a leader problem with constrained controls is tackled and a pair of optimal constrained controls are presented by a projection mapping. Furthermore, the control weights are allowed to be singular. In this case, we first investigate the uniform convexity of the cost functional whose corresponding states are fully-coupled forward-backward stochastic differential equation. After that, the minimizing sequence of solutions with non-degenerate control weights are constructed to study the weak convergence of the corresponding cost functionals. Finally, two examples are addressed for non-singular and singular cases, respectively.