We report the discovery of pressure-induced superconductivity in a semimetallic magnetic material CeTe$_{1.82}$. The superconducting transition temperature $T_{SC}$ = 2.7 K (well below the magnetic ordering temperatures) under pressure ($>$ 2 kbar) is remarkably high, considering the relatively low carrier density due to a charge-density-wave transition associated with lattice modulation. The coexisting magnetic structure of a mixed ferromagnetism and antiferromagnetism can provide a clue for this high $T_{SC}$. We discuss a theoretical model for its possible pairing symmetry and pairing mechanism.