In the quest for realizations of quantum spin liquids, the exploration of Kitaev materials - spin-orbit entangled Mott insulators with strong bond-directional exchanges - has taken center stage. However, in these materials the local spin-orbital j=1/2 moments typically show long-range magnetic order at low temperature, thus defying the formation of a spin-liquid ground state. Using resonant inelastic x-ray scattering (RIXS), we here report on a proximate spin liquid regime with clear fingerprints of Kitaev physics in the magnetic excitations of the honeycomb iridates alpha-Li2IrO3 and Na2IrO3. We observe a broad continuum of magnetic excitations that persists up to at least 300K, more than an order of magnitude larger than the magnetic ordering temperatures. We prove the magnetic character of this continuum by an analysis of the resonance behavior. RIXS measurements of the dynamical structure factor for energies within the continuum show that dynamical spin-spin correlations are restricted to nearest neighbors. Notably, these spectroscopic observations are also present in the magnetically ordered state for excitation energies above the conventional magnon excitations. Phenomenologically, our data agree with inelastic neutron scattering results on the related honeycomb compound RuCl3, establishing a common ground for a proximate Kitaev spin-liquid regime in these materials.