We studied a simple gene regulatory network, the toggle switch. Specifically, we examined the means and statistical fluctuations in numbers of proteins. We found that when omega, the ratio of rates of protein-gene unbinding to protein degradation, was between similar to 10(-3) and similar to 10, the fluctuations were much larger than those we would have expected from Poisson statistics. In addition, we examined characteristic time values for system relaxation and found both that they increased with omega and that they have significant phase transition effects, with a secondary time scale appearing near the boundary between bistable and other phases. Last, we discuss the bistability of the toggle switch.