We study the $K^+pto pi^+KN$ reaction with kinematical condition suited to the production of the $Theta^+$ resonance. It is shown that in this reaction with the polarization experiment, a combined consideration of the strength at the peak and the angular dependence of cross section can help determine the $Theta^+$ quantum numbers.