The gamma-ray deficit toward the Galactic center