Genomic analyses estimated that the proportion of the genome encoding proteins corresponds to approximately 1.5%, while at least 66% are transcribed, suggesting that many non-coding DNA-regions generate non-coding RNAs (ncRNAs). The relevance of these ncRNAs in biological, physiological as well as in pathological processes increased over the last two decades with the understanding of their implication in complex regulatory networks. This review particularly focuses on the involvement of two large families of ncRNAs, namely microRNAs (miRNAs) and long non-coding RNAs (lncRNAs) in the regulation of hematopoiesis. To date, miRNAs have been widely studied, leading to a wealth of data about processing, regulation and mechanisms of action and more specifically, their involvement in hematopoietic differentiation. Notably, the interaction of miRNAs with the regulatory network of transcription factors is well documented whereas roles, regulation and mechanisms of lncRNAs remain largely unexplored in hematopoiesis; this review gathers current data about lncRNAs as well as both potential and confirmed roles in normal and pathological hematopoiesis.