Quantitative differential interference contrast microscopy is demonstrated here as a label-free method, which is able to image and measure the thickness of lipid bilayers with 0.1 nm precision. We investigate the influence of the substrate on the thickness of fluid-phase 1,2-dioleoyl-sn-glycero-3-phosphocholine (DOPC)-supported lipid bilayers and find a thinning of up to 10%, depending on substrate hydrophilicity, local bilayer coverage, and ionic strength of the medium. With fluorescently labeled lipid bilayers, we also observe changes in the bilayer thickness depending on the choice of fluorophore. Furthermore, liquid-ordered domains in bilayers, formed from DOPC, cholesterol, and sphingomyelin, are measured, and the corresponding thickness change between the liquid-ordered and liquid-disordered phases is accurately determined. Again, the thickness difference is found to be dependent on the presence of the fluorophore label, highlighting the need for quantitative label-free techniques.