This Astro2020 white paper advocates for a multi-messenger approach that combines high-energy neutrino and broad multi-wavelength electromagnetic observations to study AGN during the coming decade. The unique capabilities of these joint observations promise to solve several long-standing issues in our understanding of AGN as powerful cosmic accelerators.