Failures of weak approximation in families