Photon-jet azimuthal correlations in proton-nucleus collisions are a promising tool for gaining information on the gluon distribution of the nucleus in the regime of non-linear color fields. We compute such correlations from the process $g+Ato q bar{q} gamma$ in the rapidity regime where both the projectile and target light-cone momentum fractions are small. By integrating over the phase space of the quark which emits the photon, subject to the restriction that the photon picks up most of the transverse momentum (to pass an isolation cut), we effectively obtain a $g+Ato q gamma$ process. For nearly back-to-back photon-jet configurations we find that it dominates over the leading order process $q+Ato q gamma$ by two less powers of $Q_perp / Q_S$, where $boldsymbol{Q}_perp$ and $Q_S$ denote the net photon-jet pair momentum and the saturation scale of the nucleus, respectively. We determine the transverse momentum dependent gluon distributions involved in $g+Ato q gamma$ and the scale where they are evaluated. Finally, we provide analytic expressions for $langlecos nphirangle$ moments, where $phi$ is the angle between $boldsymbol{Q}_perp$ and the average photon-jet transverse momentum $tilde{boldsymbol{P}}_perp$, and first qualitative estimates of their transverse momentum dependence.