Imidazolium-based ionic liquids have been widely utilized as versatile solvents for metal nanoparticle synthesis; however, reactions to synthesize silver nanoparticles that are performed identically in different commercially obtained lots of 1-butyl-3-methylimidazolium tetrafluoroborate (BMIM-BF4) give divergent results. This suggests that impurities in these nominally identical solvents play an important role in the resulting silver nanoparticle quality. To test the effect that impurities have on the quality of silver nanoparticles synthesized in BMIM-BF4, silver nanoparticles were synthesized in carefully prepared and purified BMIM-BF4 and compared against silver nanoparticles that were synthesized in the purified BMIM-BF4 that had been spiked with trace amounts of water, chloride, and 1-methylimidazole. It was clearly demonstrated that trace amounts of these common ionic liquid impurities cause significant deviation in size and shape (creating polydisperse and irregularly shaped ensembles of both large and small particles), and also negatively impact the stabilization of the resulting silver nanoparticles.