Polyaniline/graphene hydrogel composites with a macroscopically phase-separated structure are prepared. The composites show high specific capacitance and excellent rate performance. Further investigation demonstrates that polyaniline inside the graphene hydrogel has low rate performance, thus a phase-separated structure, in which polyaniline is mainly outside the graphene hydrogel matrix, can enhance the rate performance of the composites.