Calcium carbonate was crystallized in alkaline silica gel with the presence of glycine. The crystallization proceeded with a counterdiffusion method by the reaction of calcium chloride and sodium carbonate. Optical microscopy observation showed a significant effect of glycine on the morphology control of calcite crystals. When the initial concentration of glycine was high enough (10 mg/mL, 20 mg/mL), spherical vaterite particles formed in alkaline silica gel concomitantly together with dumbbell shaped calcite particles. The in situ study by micro-Raman spectroscopy demonstrated that both vaterite and the concomitant calcite were stable phases during their growth processes since the initial appearance. A possible mechanism has been discussed to emphasize the effect of glycine on the nucleation of vaterite and the morphological control of calcite.