In order to improve the compatibility between magnesium hydroxide (MH) and polymer matrix, the surface of MH was modified using vinyltriethoxysilane (VTES) by dry process and the interfacial interaction between MH and VTES was also studied. Zeta potential measurements implied that the MH particles had better dispersion and less aggregation after modification. Sedimentation tests showed that the surface of MH was transformed from hydrophilic to hydrophobic, and the dispersibility and the compatibility of MH particles significantly improved in the organic phase. Scanning electronic microscopy (SEM), Transmission electron microscopy (TEM) and X-ray powder diffraction (XRD) analyses showed that a thin layer had formed on the surface of the modified MH, but did not alter the material's crystalline phase. Fourier transform infrared (FT-IR) spectra, X-ray photoelectron spectra (XPS) and Thermogravimetric analysis (TGA) showed that the VTES molecules bound strongly to the surface of MH after modification. Chemical bonds (Si-O-Mg) formed by the reaction between Si-OC2H5 and hydroxyl group of MH, also there have physical adsorption effect in the interface simultaneously. A modification mechanism of VTES on the MH surface by dry process was proposed, which different from the modification mechanism by wet process. (C) 2016 Elsevier B.V. All rights reserved.