Plasmonics is a rapidly growing field spanning research and applications across chemistry, physics, optics, energy harvesting, and medicine. Ultrafast photoemission electron microscopy (PEEM) has demonstrated unprecedented power in the characterization of surface plasmons and other electronic excitations, as it uniquely combines the requisite spatial and temporal resolution, making it ideally suited for 3D space and time coherent imaging of the dynamical plasmonic phenomena on the nanofemto scale. The ability to visualize plasmonic fields evolving at the local speed of light on subwavelength scale with optical phase resolution illuminates old phenomena and opens new directions for growth of plasmonics research. In this review, we guide the reader thorough experimental description of PEEM as a characterization tool for both surface plasmon polaritons and localized plasmons and summarize the exciting progress it has opened by the ultrafast imaging of plasmonic phenomena on the nanofemto scale.