Based on the ideas of the set-membership identification, we present in this paper variable gain least mean-square (LMS) and weighted recursive least-squares (WRLS) algorithms. It is shown that the proposed algorithms possess a fast tracking ability to the variations of the parameter and at the same time are less sensitive to noise leading to a smooth steady state.