We use frequency comb-based optical two-way time-frequency transfer (O-TWTFT) to measure the optical frequency ratio of state-of-the-art ytterbium and strontium optical atomic clocks separated by a 1.5 km open-air link. Our free-space measurement is compared to a simultaneous measurement acquired via a noise-cancelled fiber link. Despite non-stationary, ps-level time-of-flight variations in the free-space link, ratio measurements obtained from the two links, averaged over 30.5 hours across six days, agree to $6times10^{-19}$, showing that O-TWTFT can support free-space atomic clock comparisons below the $10^{-18}$ level.