Membrane test cells are used for screening, quality assurance and in many research studies. However, the data collected in lab scale experiments has a limited reliability. This study evaluates the factors influencing the scatter of test cell data and the inconsistency compared with real membrane modules. Improvements in the test cell design and experimental procedure, increasing the data reliability, are proposed.