We report investigations of specific and nonspecific adsorption effects on bioresponsive hydrogel microlenses to better understand their utility and potential advantages for biosensing. Bioresponsive microgels were prepared from stimuli-responsive poly(N-isopropylacrylamide-co-acrylic acid) (pNIPAM-co-AAc) microgels after functionalization with both biotin and ABP (as a photoaffinity label) via carbodiimide chemistry. Bioresponsive hydrogel microlenses were then constructed from the microgels via Coulombic assembly of the anionic microgels on a positively charged, silane-modified, glass substrate. Specific and nonspecific protein binding on the hydrogel microlenses was studied by monitoring the optical properties using brightfield and fluorescence optical microscopies. The bioresponsivity, as determined by changes in the microlensing power, is strongly coupled to the formation of cross-links via ligand-protein and/or antigen-antibody binding. However, the microlensing phenomenon and the intrinsic bioresponsivity of the hydrogels are completely insensitive to simple adsorption via nonspecific protein binding from reconstituted human serum. These results suggest that the hydrogel microlens construct may be a good candidate for a wide range of applications in which the bioresponsive material would be required to operate in complex biological media.