We investigate dipole oscillations of ultracold Fermi gases along the BEC-BCS crossover through disordered potentials. We observe a disorder-induced damping of oscillations as well as a change of the fundamental Kohn-mode frequency. The measurement results are compared to numerical density matrix renormalization group calculations as well as to a three-dimensional simulation of non-interacting fermions. Experimentally, we find a disorder-dependent damping, which grows approximately with the second power of the disorder strength. Moreover, we observe experimentally a change of oscillation frequency which deviates from the expected behavior of a damped harmonic oscillator on a percent level. While this behavior is qualitatively expected from the theoretical models used, quantitatively the experimental observations show a significantly stronger effect than predicted by theory. Furthermore, while the frequency shift seems to scale differently with interaction strength in the BEC versus BCS regime, the damping coefficient apparently decreases with the strength of interaction, but not with the sign, which changes for BEC and BCS type Fermi gases. This is surprising, as the dominant damping mechanisms are expected to be different in the two regimes.