Reconciling the Observed Star-forming Sequence with the Observed Stellar Mass Function