Runaway electrons are generated in a magnetized plasma when the parallel electric field exceeds a critical value. For such electrons with energies typically reaching tens of MeV, the Abraham-Lorentz-Dirac (ALD) radiation force, in reaction to the synchrotron emission, is significant and can be the dominant process limiting the electron acceleration. The effect of the ALD-force on runaway electron dynamics in a homogeneous plasma is investigated using the relativistic finite-difference Fokker-Planck codes LUKE [Decker & Peysson, Report EUR-CEA-FC-1736, Euratom-CEA, (2004)] and CODE [Landreman et al, Comp. Phys. Comm. 185, 847 (2014)]. Under the action of the ALD force, we find that a bump is formed in the tail of the electron distribution function if the electric field is sufficiently large. We also observe that the energy of runaway electrons in the bump increases with the electric field amplitude, while the population increases with the bulk electron temperature. The presence of the bump divides the electron distribution into a runaway beam and a bulk population. This mechanism may give rise to beam-plasma types of instabilities that could in turn pump energy from runaway electrons and alter their confinement.