Decay of correlations for critically intermittent systems