A method to reconstruct spectral reflectance from RGB images is presented without priori knowledge of camera's spectral responsivity. To obtain the spectral reflectance of a pixel or region in images, this method assumes that reflectance is a weighted average of reflectances of samples in a selected training group, in which all samples have smaller color difference with that pixel or region. Four proposed weighting modes with different selected numbers of training samples were investigated. Among them, the inverse square weighting mode obtains the best performance, and it is not very sensitive to the selected training samples number. Experimental results show that all weighting modes outperform the traditional method in terms of root mean squared error and Goodness-of-Fit Coefficient between the actual and the reconstructed reflectances as well as color differences under the other light condition. (C) 2016 Wiley Periodicals, Inc.