We have measured the beam-normal single-spin asymmetry $A_n$ in the elastic scattering of 1-3 GeV transversely polarized electrons from $^1$H and for the first time from $^4$He, $^{12}$C, and $^{208}$Pb. For $^1$H, $^4$He and $^{12}$C, the measuremen
ts are in agreement with calculations that relate $A_n$ to the imaginary part of the two-photon exchange amplitude including inelastic intermediate states. Surprisingly, the $^{208}$Pb result is significantly smaller than the corresponding prediction using the same formalism. These results suggest that a systematic set of new $A_n$ measurements might emerge as a new and sensitive probe of the structure of heavy nuclei.
