Uncertainties in primordial black-hole constraints on the primordial power spectrum