We show the existence of Lorentz invariant Berry phases generated, in the Stueckleberg-Horwitz-Piron manifestly covariant quantum theory (SHP), by a perturbed four dimensional harmonic oscillator. These phases are associated with a fractional perturbation of the azimuthal symmetry of the oscillator. They are computed numerically by using time independent perturbation theory and the definition of the Berry phase generalized to the framework of SHP relativistic quantum theory.