The membrane potential of nonexcitable cells, defined as the electrical potential difference between the cell cytoplasm and the extracellular environment when the current is zero, is controlled by the individual electrical conductance of different ion channels. In particular, inward- and outward-rectifying voltage-gated channels are crucial for cell hyperpolarization/depolarization processes, being amenable to direct physical study. High (in absolute value) negative membrane potentials are characteristic of terminally differentiated cells, while low membrane potentials are found in relatively depolarized, more plastic cells (e.g., stem, embryonic, and cancer cells). We study theoretically the hyperpolarized and depolarized values of the membrane potential, as well as the possibility to obtain a bistability behavior, using simplified models for the ion channels that regulate this potential. The bistability regions, which are defined in the multidimensional state space determining the cell state, can be relevant for the understanding of the different model cell states and the transitions between them, which are triggered by changes in the external environment.