The electromagnetic scattering properties of topological insulator (TI) spheres are systematically studied in this paper. Unconventional backward scattering caused by the topological magneto-electric (TME) effect of TIs are found in both Rayleigh and Mie scattering regimes. This enhanced backward scattering can be achieved by introducing an impedance-matched background which can suppress the bulk scattering. For the cross-polarized scattering coefficients, interesting antiresonances are found in the Mie scattering regime, wherein the cross-polarized electromagnetic fields induced by the TME effect are trapped inside TI spheres. In the Rayleigh limit, the quantized TME effect of TIs can be determined by measuring the electric-field components of scattered waves in the far field.