Isotope shifts of the 2$p_{3/2}$-2$p_{1/2}$ transition in B-like ions are evaluated for a wide range of the nuclear charge number: Z=8-92. The calculations of the relativistic nuclear recoil and nuclear size effects are performed using a large scale configuration-interaction Dirac-Fock-Sturm method. The corresponding QED corrections are also taken into account. The results of the calculations are compared with the theoretical values obtained with other methods. The accuracy of the isotope shifts of the 2$p_{3/2}$-2$p_{1/2}$ transition in B-like ions is significantly improved.