Plants associate with numerous microbes, but little is known about how microbiome components, especially fungi, adapt to specific plant compartments. The adaptability of microbial function to the plant compartment is also not clear especially for woody species. Here, we characterized the bacterial and fungal communities in root endosphere, stems, and rhizospheres of 33 Broussonetia papyrifera seedlings, based on amplification of 16S and ITS rRNA. Results showed that the alpha-diversity indexes of the bacterial community were significantly different in different plant compartments and they significantly increased from stem to root endosphere to the rhizosphere, whereas those of the fungal community were similar (p > 0.05). However, the result of constrained PCoA (CPCoA) and analysis of similarity (ANOSIM) showed that both bacterial and fungal compositions were significantly affected by plant compartments (p < 0.01). In detail, the operational taxonomic units (OTUs) distribution of the bacterial community was significantly different, but 249 of 252 fungal OTUs were shared in different plant compartments. Both the bacterial and fungal compositions were significantly influenced by plant compartments, based on the result on phyla, core OTUs, and indicator OTUs level. Further, 40 of 42 enriched KEGG pathways involving the bacteria also differed significantly among plant compartments (p < 0.01). This study provides an understanding of the influence of plant compartments on the microbiome and confirms that the disperse limitation of fungal OTUs across different plant compartments is smaller. This study sheds light on how the microbial community adapts to and thrives in different plant compartments.