The crystal structures of reduced-reoxidized ceria-zirconia solid solutions, Ce2Zr2O7+x, with an ordered arrangement of Ce and Zr ions were studied by transmission electron microscopy (TEM), X-ray powder diffraction and thermogravimetric analysis. The oxygen absorption of Ce2Zr2O7 with pyrochlore structure (space group Fd3m) was revealed to proceed through two-step reaction; reaction from Ce2Zr2O7 to beta-Ce2Zr2O7.5 around 400K and reaction from beta-Ce2Zr2O7.5 to Ce2Zr2O8 about 600K. beta-Ce2Zr2O7.5 phase with space group F43m was thought to be formed by occupation of the half ordered oxygen vacancies with oxygen ions periodically. The oxidation from Ce2Zr2O7 to beta-Ce2Zr2O7.5 was also occurred at room temperature by keeping for about 1 year or by irradiation of an electron beam in TEM. On the other hand, the crystal structure of Ce2Zr2O8, completely oxidized state of Ce2Zr2O7, belongs to the space group of P43m or P23 from the rule for possible diffractions and the symmetry of the ordering cations.