Increasing data rate in optical communication systems leads to nonlinear electromagnet phenomenon in optical signal along fiber, and causes distortion in it.Thefiber dispersion is a linear phenomenon that causes difficulties toachieve high bit rate and distance product.The limiting of nonlinear effects requireslow input power level, but this induces lowsignal to noise ratio. So, we search another solutions. This paper studies Split Step Fourier Transform Algorithm (SSFTM) used to solve partial differential nonlinear Schrödinger equation (NLSE).Then, we use it for simulating optical signal propagating in fiber by using MATLAB program, and designing fiber optic block could add it to MATLAB Simulink Library. Finally ,in this paper, we achieved results for selecting important parameters in single mode fiber for high bit rate, for improving bit error rate and Qcoefficient.