It is shown that polynomial gravity theories with more than four derivatives in each scalar and tensor sectors have a regular weak-field limit, without curvature singularities. This is achieved by proving that in these models the effect of the higher derivatives can be regarded as a complete regularization of the delta-source. We also show how this result implies that a wide class of non-local ghost-free gravities have a regular Newtonian limit too, and discuss the applicability of this approach to the case of weakly non-local models.