The temporal variability of the solar resource - which occurs at different time scales - is a major concern regarding its impact on the grid and photovoltaic (PV) power plants. To handle the increasing penetration rate of solar energy, grid managers require accurate forecasts of incident solar irradiance. This work discusses standard and new procedures to assess the quality of solar forecasting models and highlights the limitations of some widely used metrics in concrete situations. The paper recommends practices for characterizing the quality of a forecast, i.e. a quality control to reject any suspicious data; classifications to relate each performance criterion to the nature of the solar irradiance variability; and a wide selection of established and new metrics. In this context, two new metrics are notably proposed in order to obtain more complete information about the performance of a forecasting method. This article aims to make a step towards standardizing metrics for solar forecasting by taking into account some of the new metrics recently presented in the literature. (C) 2017 Elsevier Ltd. All rights reserved.