The factors determining species commonness and rarity are poorly understood, particularly in highly diverse communities. Theory predicts that interactions with neighbors of the same (conspecific) and other (heterospecific) species can influence a species' relative abundance, but empirical tests are lacking. By using a hierarchical model of survival for more than 30,000 seedlings of 180 tropical tree species on Barro Colorado Island, Panama, we tested whether species' sensitivity to neighboring individuals relates to their relative abundance in the community. We found wide variation among species in the effect of conspecific, but not heterospecific, neighbors on survival, and we found a significant relationship between the strength of conspecific neighbor effects and species abundance. Specifically, rare species suffered more from the presence of conspecific neighbors than common species did, suggesting that conspecific density dependence shapes species abundances in diverse communities.