An Étude on the regularization and renormalization of divergences in primordial observables