The gauge dependence of the scalar induced gravitational waves (SIGWs) generated at the second order imposes a challenge to the discussion of the secondary gravitational waves generated by scalar perturbations. We provide a general formula that is valid in any gauge for the calculation of SIGWs and the relationship for SIGWs calculated in various gauges under the coordinate transformation. The formula relating SIGWs in the Newtonian gauge to other gauges is used to calculate SIGWs in six different gauges. We find that the Newtonian gauge, the uniform curvature gauge, the synchronous gauge and the uniform expansion gauge yield the same result for the energy density of SIGWs. We also identify and eliminate the pure gauge modes that exist in the synchronous gauge. In the total matter gauge and the comoving orthogonal gauge, the energy density of SIGWs increases as $eta^2$. While in the uniform density gauge, the energy density of SIGWs increases as $eta^6$.