Multiband polarimetric imaging of HR 4796A with the Gemini Planet Imager