Structures, dynamics, and stabilities of different sized cellulosic oligomers need to be considered when designing enzymatic cocktails for the conversion of biomass to biofuels since they can be both productive substrates and inhibitors of the overall process. In the present work, the conformational variability, hydrogen bonding, and mechanical properties of short, soluble cellulose chains are investigated as a function of chain length. Cellulose oligomers consisting 2, 4, and 6 beta-D-glucose units are examined in explicit solvent using replica exchange molecular dynamics (REMD) which provides a rigorous evaluation of the relative stabilities of different conformations and their temperature dependencies. This application of REMD to oligosaccharides in solution also allows evaluation of the quality of the force-field and its suitability for sampling carbohydrates efficiently. Simulation results are analyzed in synergy with polymer theory and compared to known measurements of oligomers and crystals. As the chain length is increased, the conformations of the oligomers become more rigid and likely to form intrachain hydrogen bonds, like those found in crystals. Several other conformations and hydrogen bonding patterns distinguish these short cellulose chains from those in cellulose crystals. These studies have also addressed the key role played by solvent on shifting the conformational preferences of the oligosacchandes with respect to vacuum and crystals. Correlation between pyranose ring flipping and the conformation of the 1,4-glycosidic bond was observed.