Most small molecules are unable to rapidly traverse the outer membrane of Gram-negative bacteria and accumulate inside these cells, making the discovery of much-needed drugs against these pathogens challenging. Current understanding of the physicochemical properties that dictate small-molecule accumulation in Gram-negative bacteria is largely based on retrospective analyses of antibacterial agents, which suggest that polarity and molecular weight are key factors. Here we assess the ability of over 180 diverse compounds to accumulate in Escherichia coli. Computational analysis of the results reveals major differences from the retrospective studies, namely that the small molecules that are most likely to accumulate contain an amine, are amphiphilic and rigid, and have low globularity. These guidelines were then applied to convert deoxynybomycin, a natural product that is active only against Gram-positive organisms, into an antibiotic with activity against a diverse panel of multi-drug-resistant Gram-negative pathogens. We anticipate that these findings will aid in the discovery and development of antibiotics against Gram-negative bacteria.