Combining the quantum optical properties of single-photon emitters with the strong near-field interactions available in nanophotonic and plasmonic systems is a powerful way of creating quantum manipulation and metrological functionalities. The ability to actively and dynamically modulate emitter-environment interactions is of particular interest in this regard. While thermal, mechanical and optical modulation have been demonstrated, electrical modulation has remained an outstanding challenge. Here we realize fast, all-electrical modulation of the near-field interactions between a nanolayer of erbium emitters and graphene, by in-situ tuning the Fermi energy of graphene. We demonstrate strong interactions with a >1,000-fold increased decay rate for 25% of the emitters, and electrically modulate these interactions with frequencies up to 300 kHz - orders of magnitude faster than the emitters radiative decay (100 Hz). This constitutes an enabling platform for integrated quantum technologies, opening routes to quantum entanglement generation by collective plasmon emission or photon emission with controlled waveform.