We report a simple and efficient all-optical polarization scrambler based on the nonlinear interaction in an optical fiber between a signal beam and its backward replica which is generated and amplified by a reflective loop. When the amplification factor exceeds a certain threshold, the system exhibits a chaotic regime in which the evolution of the output polarization state of the signal becomes temporally chaotic and scrambled all over the surface of the Poincare sphere. We derive some analytical estimations for the scrambling performances of our device which are well confirmed by the experimental results. The polarization scrambler has been successfully tested on a single channel 10-Gbit/s On/Off Keying Telecom signal, reaching scrambling speeds up to 250-krad/s, as well as in a wavelength division multiplexing configuration. A different configuration based on a sequent cascade of polarization scramblers is also discussed numerically, which leads to an increase of the scrambling performances.