Transient populations of cis- and trans-acting small RNAs have recently emerged as key regulators of extensive epigenetic changes taking place during periconception, which encompasses gametogenesis, fertilization, and early zygotic development. These small RNAs are not only important to maintain genome integrity in the gametes and zygote, but they also actively contribute to assessing the compatibility of parental genomes at fertilization and to promoting long-term memory of the zygotic epigenetic landscape by affecting chromatin. Striking parallels exist in the biogenesis and modus operandi of these molecules among diverse taxa, unraveling universal themes of small-RNA-mediated epigenetic reprogramming during sexual reproduction.