We develop an effective field theory (EFT) to describe the few- and many-body propagation of one dimensional Rydberg polaritons. We show that the photonic transmission through the Rydberg medium can be found by mapping the propagation problem to a non-equilibrium quench, where the role of time and space are reversed. We include effective range corrections in the EFT and show that they dominate the dynamics near scattering resonances in the presence of deep bound states. Finally, we show how the long-range nature of the Rydberg-Rydberg interactions induces strong effective $N$-body interactions between Rydberg polaritons. These results pave the way towards studying non-perturbative effects in quantum field theories using Rydberg polaritons.