A clustered origin for isolated massive stars