We explore the chaotic dynamics of Rayleigh-Benard convection using large-scale, parallel numerical simulations for experimentally accessible conditions. We quantify the connections between the spatiotemporal dynamics of the leading-order Lyapunov vector and different measures of the flow field patterns topology and dynamics. We use a range of pattern diagnostics to describe the spatiotemporal features of the flow field structures which includes many of the traditional diagnostics used to describe convection as well as some diagnostics tailored to capture the dynamics of the patterns. Using precision-recall curves, we quantify the complex relationship between the pattern diagnostics and the regions where the magnitude of the leading-order Lyapunov vector is significant.