In this technical note, we consider the cooperative output regulation of linear multi-agent systems. The overall system consists of two groups of subsystems. While the first group of subsystems can access the exogenous signal, the second cannot. As a result, the problem cannot be solved by the decentralized approach. By devising a distributed observer, we can solve the problem by a dynamic full information distributed control scheme. The problem can also be viewed as a generalization of some results of the leader-following consensus problem of multi-agent systems.