How the carrier momentum influences the polarization properties of a vertical-cavity semiconductor laser