Being WISE II: Reducing the Influence of Star formation History on the Mass-to-Light Ratio of Quiescent Galaxies