Layered double hydroxide-quantum dot (LDH-QD) composites are synthesized via a room temperature LDH formation reaction in the presence of QDs. InP/ZnS (core/shell) QD, a heavy metal free QD, is used as a model constituent. Interactions between QDs (with negative zeta potentials), decorated with dihydrolipoic acids, and inherently positively charged metal hydroxide layers of LDH during the LDH formations are induced to form the LDH-QD composites. The formation of the LDH-QD composites affords significantly enhanced photoluminescence quantum yields and thermal- and photostabilities compared to their QD counterparts. In addition, the fluorescence from the solid LDH-QD composite preserved the initial optical properties of the QD colloid solution without noticeable deteriorations such as red shift or deep trap emission. Based on their advantageous optical properties, we also demonstrate the pseudo white light emitting diode, down-converted by the LDH-QD composites.