We present $^{75}$As nuclear magnetic resonance spin-lattice and spin-spin relaxation rate data in Ba(Fe$_{1-x}$Co$_x$)$_2$As$_2$ and Ba(Fe$_{1-x}$Cu$_x$)$_2$As$_2$ as a function of temperature, doping and magnetic field. The relaxation curves exhibit a broad distribution of relaxation rates, consistent with inhomogeneous glassy behavior up to 100 K. The doping and temperature response of the width of the dynamical heterogeneity is similar to that of the nematic susceptibility measured by elastoresistance measurements. We argue that quenched random fields which couple to the nematic order give rise to a nematic glass that is reflected in the spin dynamics.