A spectral-based method can acquire and represent the surface appearance of a given material physically correctly. But, it has drawbacks due to its high measurement cost and a long computation time in measuring, modeling, and rendering. In this article, we present spectral recovery and representation of spectral bidirectional reflectance distribution function (BRDF) from multispectral reflectance measurements in which we can render real appearance materials over a 3D model with accuracy and efficiency. First of all, an accurate spectral BRDF recovery algorithm, which transforms multispectral high dynamic range images into highly dense BRDFs in both a spectral and an angular domain, is proposed. Second, an efficient representation method is developed representing spectral BRDFs compactly using a factorization method and an adaptive spectral sampling method that uses a given error bound. The results show that the proposed method can compress the spectral BRDF data down by several hundred times while maintaining the given accuracy in colorimetric and spectral domains under a specific illuminant. (c) 2015 Wiley Periodicals, Inc. Col Res Appl, 41, 358-371, 2016