A model for the rheological properties of a concentrated suspension in weakly viscoelastic fluid matrices is proposed. The model is derived according to the Roscoe differential procedure described in 1952. The analytical results produced recently by Greco et al. (J Non-Newton Fluid Mech 147:1-10, 2007) and Housiadas and Tanner (J Non-Newton Fluid Mech 162:88-92, 2009) for dilute suspensions of neutrally buoyant, non-Brownian rigid spheres in weakly viscoelastic matrix fluids are the key results which are used as a base to predict the properties of concentrated suspensions. The results are compared with the few available experimental data from the literature, showing promising trends for the viscometric properties of the suspensions. In particular, one sees the rapidly increasing value of -N-2/N-1 as concentration increases.