The properties of the interstellar medium in dusty star-forming galaxies at z ~ 2-4: the shape of the CO spectral line energy distributions