We use an effective field theory (EFT) which includes all possible gluon-Higgs dimension-5 and dimension-7 operators to study Higgs boson plus jet production in next-to-leading order QCD. The EFT sheds light on the effect of a finite top quark mass as well as any Beyond-the-Standard Model (BSM) modifications of Higgs-gluon effective couplings. In the gluon channel, the accuracy of the heavy-top approximation for differential distributions arises from the non-interference between the helicity amplitudes of the G^3 h and G^2 h operators in the m_h < p_T limit at lowest order. One dimension-7 operator involving quark bilinears, however, contributes significantly at high p_T, and potentially offers a channel for seeing BSM effects. One-loop renormalization of these operators is determined, allowing resummation of large logarithms via renormalization group running. NLO numerical results at the LHC are presented, which include O(1/m_t^2) contributions in the SM limit.