Because of the poor impact behavior of polypropylene (PP) at low temperatures, the blending of PP with metallocene-polymerized polyethylene (mPE) elastomers was investigated in this study. However, a reduced modulus of the overall blend was inevitable because of the addition to elastomers. To obtain a balance of the properties, we introduced rigid inorganic fillers to PP/mPE blends. The performance of the composites was characterized with tensile and Charpy notched impact tests, and the fracture morphology was examined with scanning electron microscopy. The results showed that the effects of fillers in a brittle matrix and in a ductile matrix were quantitatively different. For PP/mPE/filler ternary composites, the dependence of Young's modulus and yield strength on CaCO3 content was not significant compared with that of PP/filler binary composites, whereas the elongation at break and tensile toughness at room temperature for PP/mPE/filler systems were more improved. The impact strength of the PP/mPE blends filled with untreated glass beads and CaCO3 at a low temperature was lowered because of the weak interfacial bond. However, the values of the impact strength of the PP/mPE/filler composites at a low temperature remained at a high level compared with that of pure PP. In particular, a PP/MPE blend filled with surface-treated kaolin had a higher low-temperature impact toughness than the unfilled blend.