We investigate second order conformal perturbation theory for $mathbb{Z}_2$ orbifolds of conformal field theories in two dimensions. To evaluate the necessary twisted sector correlation functions and their integrals, we map them from the sphere to its torus double cover. We discuss how this relates crossing symmetry to the modular group, and introduce a regularization scheme on the cover that allows to evaluate the integrals numerically. These methods do not require supersymmetry. As an application, we show that in the torus orbifold of 8 and 16 free bosons, $mathbb{Z}_2$ twist fields are marginal at first order, but stop being marginal at second order.