Interfacial water structures of aqueous dimethyl sulfoxide (DMSO) and methanesulfonic acid (MSA) were studied by Raman, infrared, and conventional and phase-sensitive vibrational sum frequency generation (VSFG) spectroscopies. Through isotopic dilution, we probed bulk water hydrogen bonding strength using the vibrational frequency of dilute OD in H2O. As indicated by the frequency shift of the OD frequency, it is shown that DMSO has little influence on the average water hydrogen bonding strength at low concentrations in contrast with an overall weakening effect for MSA. For the water structure at the surface of aqueous solutions, although conventional VSFG spectra suggest only slight structural changes with DMSO and a red shift of hydrogen-bonded water OH frequency, phase-sensitive VSFG reveals more thoroughly structural changes in the presence of both DMSO and MSA. In the case of DMSO, reorientation of interfacial water molecules with their hydrogens pointing up toward the oxygen of the S=O group is observed. For MSA, the interfacial water structure is affected by both the dissociated methanesulfonate anions and the hydronium ions residing at the surface. Both the methanesulfonate anions and the hydronium ions have surface preference; therefore, the electric double layer (EDL) formed at the surface is relatively thin, which leads to partial reorientation of interface water molecules with net orientation of water hydrogens up. Surface DMSO molecules are more effective at reorienting surface water relative to MSA molecules.