Drying polymer dispersions usually experience tensile stress, induced by the reduction in volume and by the rigid substrate. Due to edge-in drying, the stress is usually heterogeneous over the film. Stress peaks play a decisive role in the formation of cracks. This work relies on membrane bending, a technique that provides spatially resolved stress maps. In the experiments reported here, stress fluctuations on the order of 10% on the time scale of a few seconds were found. The stress fluctuations occur coherently over the entire drying front. Fluctuations go back to slight fluctuations in humidity of the environment (as opposed to local stress relaxations due to reorganizations of the particle network). The stress fluctuations disappear when covering the sample with a lid. They can be enhanced by blowing humid or dry air across the sample surface. Modeling builds on the assumption that all stresses go back to capillary pressure created at the menisci in between different spheres at the film air interface. The local radius of curvature changes in response to slight variations in ambient humidity according to the Kelvin equation. The fluctuations are observed under a wide variety of drying conditions and should be included in film formation models.