As molecular modeling and simulation techniques become increasingly important sources of thermophysical property and phase equilibrium data, the ability to assess the robustness of that data becomes more critical. Recently, the use of the compressibility factor (Z) has been suggested as a metric for testing the quality of simulation data for vapor-liquid equilibria (VLE). Here, we analyze predicted VLE data from the transferable potentials for phase equilibria (TraPPE) database and show that, apart from data entry or typographical errors, Z will always be well-behaved in Gibbs ensemble Monte Carlo (GEMC) simulations even when the simulations are not sufficiently equilibrated. However, this is not true for grand canonical Monte Carlo simulations. When the pressure is calculated from the internal forces, then pressure and density are strongly correlated for the vapor phase and, for GEMC simulations, it is recommended to treat Z as an instantaneous mechanical property. From analysis of the TraPPE VLE data, we propose a complementary metric based on the predicted vapor pressures at three neighboring temperatures and their deviation from a local Clausius-Clapeyron fit.