The formation of a thin layer, the so-called Joint Oxyde-Gaine (JOG), between the (U,Pu)O-2 fuel pellets and the cladding has been observed in fast neutron reactors, due to the accumulation of volatile fission products. Cs2MoO4 is known to be one of the major components of the JOG, but other elements are also present, in particular tellurium and palladium. In this work, an investigation of the structural and thermodynamic properties of Cs2TeO4 and Cs2Mo1-xTexO4 solid solution is reported. The existence of a complete solubility between Cs2MoO4 and Cs2TeO4 is demonstrated, combining X-ray diffraction (XRD), neutron diffraction (ND), and X-ray absorption spectroscopy (XAS) results. High-temperature XRD measurements were moreover performed on Cs2TeO4, which revealed the existence of a alpha-beta phase transition around 712 K. Thermal expansion coefficients were also obtained from these data. Finally, phase equilibra points in the Cs2MoO4-Cs2TeO4 pseudobinary phase diagram were collected using differential scanning calorimetry and used to develop a thermodynamic model for this system using a regular solution formalism.