Axion-like particles (ALPs) are predicted to mediate exotic interactions between spin and mass. We propose an ALP-searching experiment based on the levitated micromechanical oscillator, which is one of the most sensitive sensors for spin-mass forces at a short distance. The proposed experiment tests the spin-mass resonant interaction between the polarized electron spins and a diamagnetically levitated microsphere. By periodically flipping the electron spins, the contamination from nonresonant background forces can be eliminated. The levitated microoscillator can prospectively enhance the sensitivity by nearly $10^3$ times over current experiments for ALPs with mass in the range 4 meV to 0.4 eV.