The vibrational energy relaxations (VERs) of the CO stretching mode of acetone and its complexes with alcohols are investigated by sub-picosecond pump-probe spectroscopy and molecular dynamics simulation. The time constants of the vibrational energy relaxation of the free acetone and that of the 1:1 complex are 4.4 and 2.3 ps for methanol solvent and 5.2 and 1.8 ps for 1-proponal solvent, respectively. The VER rate is accelerated a few times by formation of the hydrogen bond. This acceleration of the vibrational energy relaxation is successfully reproduced by the Landau-Teller method calculated from the molecular dynamics simulation. Molecular dynamics simulations reveal that the VER time of acetone with the hydrogen bond is largely affected by the solute polarization induced by solvent molecules.