Differential polarization nonlinear optical microscopy has the potential to become an indispensable tool for structural investigations of ordered biological assemblies and microcrystalline aggregates. Their microscopic organization can be probed through fast and sensitive measurements of nonlinear optical signal anisotropy, which can be achieved with microscopic spatial resolution by using time-multiplexed pulsed laser beams with perpendicular polarization orientations and photon-counting detection electronics for signal demultiplexing. In addition, deformable membrane mirrors can be used to correct for optical aberrations in the microscope and simultaneously optimize beam overlap using a genetic algorithm. The beam overlap can be achieved with better accuracy than diffraction limited point-spread function, which allows to perform polarization-resolved measurements on the pixel-by-pixel basis. We describe a newly developed differential polarization microscope and present applications of the differential microscopy technique for structural studies of collagen and cellulose. Both, second harmonic generation, and fluorescence-detected nonlinear absorption anisotropy are used in these investigations. It is shown that the orientation and structural properties of the fibers in biological tissue can be deduced and that the orientation of fluorescent molecules (Congo Red), which label the fibers, can be determined. Differential polarization microscopy sidesteps common issues such as photobleaching and sample movement. Due to tens of megahertz alternating polarization of excitation pulses fast data acquisition can be conveniently applied to measure changes in the nonlinear signal anisotropy in dynamically changing in vivo structures.