Renormalization factors relate the observables obtained on the lattice to their measured counterparts in the continuum in a suitable renormalization scheme. They have to be computed very precisely which requires a careful treatment of lattice artifacts. In this work we present a method to suppress these artifacts by subtracting one-loop contributions proportional to the square of the lattice spacing calculated in lattice perturbation theory.