Does radiative feedback make faint z < 6 galaxies look small?