Protein ubiquitination is a multifaceted post-translational modification that controls almost every process in eukaryotic cells. Recently, the Legionella effector SdeA was reported to mediate a unique phosphoribosyl-linked ubiquitination through successive modifications of the Arg42 of ubiquitin (Ub) by its mono-ADP-ribosyltransferase (mART) and phosphodiesterase (PDE) domains. However, the mechanisms of SdeA-mediated Ub modification and phosphoribosyl-linked ubiquitination remain unknown. Here we report the structures of SdeA in its ligand-free, Ub-bound and Ub-NADH-bound states. The structures reveal that the mART and PDE domains of SdeA form a catalytic domain over its C-terminal region. Upon Ub binding, the canonical ADP-ribosyltransferase toxin turn-turn (ARTT) and phosphate-nicotinamide (PN) loops in the mART domain of SdeA undergo marked conformational changes. The Ub Arg72 might act as a 'probe' that interacts with the mART domain first, and then movements may occur in the side chains of Arg72 and Arg42 during the ADP-ribosylation of Ub. Our study reveals the mechanism of SdeA-mediated Ub modification and provides a framework for further investigations into the phosphoribosyl-linked ubiquitination process.