We study the ultrafast O-H stretch vibrational relaxation dynamics of protonated water clusters embedded in a matrix of deuterated acetonitrile, using polarization-resolved mid-IR femtosecond spectroscopy. The clusters are produced by mixing triflic (trifluoromethanesulfonic) acid and H2O in molar ratios of 1:1, 1:2, and 1:3, thus varying the degree of hydration of the proton. At all hydration levels the excited O-H stretch vibration of the hydrated proton shows an ultrafast vibrational relaxation with a time constant T-1 < 100 fs, leading to an ultrafast local heating of the protonated water cluster. This excess thermal energy, initially highly localized to the region of the excited proton, first re-distributes over the aqueous cluster and then dissipates into the surrounding acetonitrile matrix. For clusters with a triflic acid to H2O ratio of 1:3 these processes occur with time constants of 320 +/- 20 fs and 1.4 +/- 0.1 ps, respectively. The cooling of the clusters reveals a long-living, underlying transient absorption change with high anisotropy. We argue that this feature stems from the vibrational predissociation of a small fraction of the proton hydration structures, directly following the ultrafast infrared excitation.