Simple models based on isotropic interparticle attractions often fail to capture experimentally observed structures of colloidal gels formed through spinodal decomposition and subsequent arrest: the resulting gels are typically denser and less branched than their experimental counterparts. Here, we simulate gels formed from soft particles with directional attractions ("patchy particles"), designed to inhibit lateral particle rearrangement after aggregation. We directly compare simulated structures with experimental colloidal gels made using soft attractive microgel particles, by employing a "skeletonization" method that reconstructs the three-dimensional backbone from experiment or simulation. We show that including directional attractions with sufficient valency leads to strongly branched structures compared to isotropic models. Furthermore, combining isotropic and directional attractions provides additional control over aggregation kinetics and gel structure. Our results show that the inhibition of lateral particle rearrangements strongly affects the gel topology and is an important effect to consider in computational models of colloidal gels.