We have searched for a short-range spin-dependent interaction mediated by a hypothetical light scalar boson with CP-violating couplings to the neutron using the spin relaxation of hyperpolarized $^3$He. The walls of the $^3$He cell would generate a depolarizing pseudomagnetic field.