Compact Star-forming Galaxies as Old Starbursts Becoming Quiescent