We characterize the nanosecond pulse switching performance of the three-terminal magnetic tunnel junctions (MTJs), driven by the spin Hall effect (SHE) in the channel, at a cryogenic temperature of 3 K. The SHE-MTJ devices exhibit reasonable magnetic switching and reliable current switching by as short pulses as 1 ns of $<10^{12}$ A/m$^{2}$ magnitude, exceeding the expectation from conventional macrospin model. The pulse switching bit error rates reach below $10^{-6}$ for < 10 ns pulses. Similar performance is achieved with exponentially decaying pulses expected to be delivered to the SHE-MTJ device by a nanocryotron device in parallel configuration of a realistic memory cell structure. These results suggest the viability of the SHE-MTJ structure as a cryogenic memory element for exascale superconducting computing systems.