We discuss the connection between the perturbative and non-perturbative renormalization and related conceptual issues in the few-nucleon sector of the low-energy effective field theory of the strong interactions. General arguments are supported by examples from effective theories with and without pions as dynamical degrees of freedom. A quantum mechanical potential with explicitly specified short- and long-range parts is considered as an underlying fundamental theory and the corresponding effective field theory potential is constructed. Further, the problem of the effective field theoretical renormalization of the Skornyakov-Ter-Martyrosian equation is revisited.