We report the detection of differential gas column densities in three gravitational lenses, MG0414+0534, HE1104-1805, and PKS1830-211. Combined with the previous differential column density measurements in B1600+434 and Q2237+0305 and the differential extinction measurements of these lenses, we probe the dust-to-gas ratio of a small sample of cosmologically distant normal galaxies. We obtain an average dust-to-gas ratio of E(B-V)/NH =(1.4pm0.5) e-22 mag cm^2/atoms with an estimated intrinsic dispersion in the ratio of ~40%. This average dust-to-gas ratio is consistent with the average Galactic value of 1.7e-22 mag cm^2/atoms and the estimated intrinsic dispersion is also consistent with the 30% observed in the Galaxy.