The conversion of biomass into biofuels can reduce the strategic vulnerability of petroleum-based systems and at the same time have a positive effect on global climate issues. Lignocellulose is the cheapest and most abundant source of biomass and consequently has been widely considered as a source for liquid fuel. However, despite ongoing efforts, cellulosic biofuels are still far from commercial realization, one of the major bottlenecks being the hydrolysis of cellulose into simpler sugars. Inspired by the structural and functional modularity of cellulases used by many organisms for the breakdown of cellulose, we propose to mimic the cellulose binding domain (CBD) and the catalytic domain of these proteins by small molecular entities. Multiple copies of these mimics could subsequently be tethered together to enhance hydrolytic activity. In this work, we take the first step toward achieving this goal by applying computational approaches to the design of efficient, cost-effective mimetics of the CBD. The design is based on low molecular weight peptides that are amenable to large-scale production. We provide an optimized design of four short (i.e., similar to 18 residues) peptide mimetics based on the three-dimensional structure of a known CBD and demonstrate that some of these peptides bind cellulose as well as or better than the full CBD. The structures of these peptides were studied by circular dichroism and their interactions with cellulose by solid phase NMR. Finally, we present a computational strategy for predicting CBD/peptide-cellulose binding free energies and demonstrate its ability to provide values in good agreement with experimental data. Using this computational model, we have also studied the dissociation pathway of the CBDs/peptides from the surface of cellulose.