The fluorite-like [Bi2O2](2+) layer is a fundamental building unit in a great variety of layered compounds. Here in this contribution, we presented a comprehensive study on an unusual Aurivillius phase Bi3.6V2O10 with respect to its defect chemistry and polymorphism control as well as implications for fast oxide ion transport at lower temperatures. The bismuth oxide layer in Bi4V2O11 is found to tolerate a large number of Bi vacancies without breaking the high temperature prototype I4/mmm structure (gamma-phase). On cooling, an orthorhombic distortion occurs to the gamma-phase, giving rise to a different type of phase (B-phase) in the intermediate temperature region. Cooling to room temperature causes a further transition to an oxygen-vacancy ordered A-phase, which is accompanied by the charge ordering of V4+ and V5+ cations, providing magnetic (d(1)) and nonmagnetic (d(0)) chains along the a axis. This is a novel charge ordering transition in terms of the concomitant change of oxygen coordination. Interestingly, upon quenching, both the gamma- and B-phase can be kinetically trapped, enabling the structural probing of the two phases at ambient temperature. Driven by the thermodynamic forces, the oxide anion in the gamma-phase undergoes an interlayer diffusion process to reshuffle the compositions of both Bi-O and V-O layers.