Persistent spectral hole burning spectroscopy is applied to evaluate the low-temperature relaxation around the dye molecules doped in several types of polymers. The doped dye is tetraphenylporphine, and the measured polymers are vinyl polymers and main chain aromatic polymers. The changes of microscopic environments around the dye are evaluated from the changes in the hole profiles during temperature cycling experiments. The relaxation behavior of the polymers is discussed in relation to their chemical structures.