We revisit the calculation of perturbative quark transverse momentum dependent parton distribution functions and fragmentation functions using the exponential regulator for rapidity divergences. We show that the exponential regulator provides a consistent framework for the calculation of various ingredients in transverse momentum dependent factorization. Compared to existing regulators in the literature, the exponential regulator has a couple of advantages which we explain in detail. As a result, the calculation is greatly simplified and we are able to obtain the next-to-next-to-leading order results up to $mathcal{O}(epsilon^2)$ in dimensional regularization. These terms are necessary for a higher order calculation which is made possible with the simplification brought by the new regulator. As a by-product, we have obtained the two-loop quark jet function for the Energy-Energy Correlator in the back-to-back limit, which is the last missing ingredient for its N$^3$LL resummation.