Germanium, copper and silver(I) oxide seed layers are investigated for their ability to reduce the roughness of silver thin films deposited on amorphous substrates. Such films are useful in disease detection and sub-wavelength imaging applications, provided their surface roughness is sufficiently low so as to give a strong plasmonic response. Surface roughness and optical transmission measurements are reported for thermally evaporated and radio frequency sputtered silver films between 10-40 nm thick, grown either directly on amorphous borosilicate glass substrates or on top of 1 nm thick seed layers. It is found that germanium, copper and silver(I) oxide seed layers all have a smoothing effect on silver films up to 20 nm thickness. In the best case, the root means square surface roughness of a 10 nm silver film thermally evaporated onto borosilicate glass was reduced from 2.16 +/- 0.16 nm to 0.71 +/- 0.04 nm by the inclusion of a 1 nm thick germanium seed layer. For films thicker than 20 nm only germanium had a significant smoothing effect. The effects of thermal annealing on the surface roughness and optical transmission of silver films grown on the various seed layers were also investigated. The optical transmission over ultraviolet and visible wavelengths was increased and the surface roughness was decreased for films grown on a germanium seed layer, but the reverse was observed for films grown on the copper or silver(I) oxide seed layers or on the bare substrate. The silver films degraded during annealing due to de-wetting, which occurred at a threshold temperature determined by the seed layer or substrate. These experiments pave a pathway towards extremely smooth, low-loss silver films at arbitrary thicknesses. Results support the development of more sensitive, robust, and reliable plasmonic devices for medical diagnosis, imaging, and particle sensing.