We study, both theoretically and experimentally, driven Rabi oscillations of a single electron spin coupled to a nuclear spin bath. Due to the long correlation time of the bath, two unusual features are observed in the oscillations. The decay follows a power law, and the oscillations are shifted in phase by a universal value of ~pi/4. These properties are well understood from a theoretical expression that we derive here in the static limit for the nuclear bath. This improved understanding of the coupled electron-nuclear system is important for future experiments using the electron spin as a qubit.