Surface brightness evolution of galaxies in the CANDELS GOODS fields up to z~6: high-z galaxies are unique or remain undetected