Empirical validation and code-to-code comparison of more than one building simulation tool has seldom been done in literature. Therefore this paper presents the first detailed comparison of 1D building energy simulation tools with 3D CFD simulation and measurement data from a test bed (Test-Box), exposed to natural environmental conditions. Dymola (library: IDEAS), EnergyPlus, IDA ICE and TRNSYS-four commonly used tools-were selected for comparison against highly accurate real measurement data and dynamic CFD results. This paper evaluates the performance of mentioned above 1D simulation tools and in particular their implemented Thermally Activated Building Systems (TABS) models. The mean error, RMSE, standard deviation and maximal error for the room air, the ceiling surface and concrete temperature of the Test-Box model results are acceptable for all tools. The time course of the room air temperature follows the measurement data relatively well for all four tools. However, the negative bias (Dymola-0.92 K, EnergyPlus-2.18 K, IDA ICE -0.37 K and TRNSYS-1.13 K) indicates a general overestimation for all tools. Furthermore, the paper reflects the properties of simulation tools regarding the modelling language, GUIs, co-simulation capabilities and their recommended field of application. (C) 2018 Elsevier B.V. All rights reserved.