A universal mechanism that controls the zero thermal expansion (ZTE) behavior of the antiperovskite manganese nitrides is discovered. Modulating the Mn occupancy at its lattice sites leads to a drastic change in the thermal expansion behavior. The Mn site occupancy can be reduced by nanostructuring the material, generating a form of "giant" ZTE.