The magnetization of single-molecule magnets (SMMs) in non-crystalline materials is probed using high-sensitivity magneto-optical techniques. The environment strongly influences the magnetic properties and dramatically changes the spin dynamics. Comparison between different materials indicates the phonon bath as a possible source of the effect. These results indicate the importance of the environment when designing and modeling SMM-based spintronic devices.