Studying is showed that the amount of exchanging information in the network surprisingly grows due to developing new communication services. But, when data rates increase the optical system performance degrades due to dispersion, which was taken into account in this research. Where as the reduction of dispersion losses is important in optical networks. Fiber Bragg Grating (FBG) is one of the most important components of optical communication systems, and one of the effective methods used for this goal. This article tests the effect of using FBG as dispersion compensator in optical communication systems, where we simulate optical communication system using FBG. And study the effect of Erbium Doped Fiber Amplifier (EDFA) and FBG and fiber optic parameters on this system performance, and it has been finding the best values of the system parameters. Which the simulation model depended on two Optisystem7 and Matlab software. We evaluate performance through eye diagram and two factors Q, Bit Error Rate (BER).