We consider abstract second order evolution equations with unbounded feedback with time-varying delay. Existence results are obtained under some realistic assumptions. We prove the exponential decay under some conditions by introducing an abstract Lyapunov functional. Our abstract framework is applied to the wave, to the beam, and to the plate equations with boundary delays.