Two-photon exchange contributions to elastic electron-proton scattering cross sections are evaluated in a simple hadronic model including the finite size of the proton. The corrections are found to be small in magnitude, but with a strong angular dependence at fixed $Q^2$. This is significant for the Rosenbluth technique for determining the ratio of the electric and magnetic form factors of the proton at high $Q^2$, and partly reconciles the apparent discrepancy with the results of the polarization transfer technique.