The Eulerian space-time correlation of strong Magnetohydrodynamic (MHD) turbulence in strongly magnetized plasmas is investigated by means of direct numerical simulations of Reduced MHD turbulence and phenomenological modeling. Two new important results follow from the simulations: 1) counter-propagating Alfvenic fluctuations at a each scale decorrelate in time at the same rate in both balanced and imbalanced turbulence; and 2) the scaling with wavenumber of the decorrelation rate is consistent with pure hydrodynamic sweeping of small-scale structures by the fluctuating velocity of the energy-containing scales. An explanation of the simulation results is proposed in the context of a recent phenomenological MHD model introduced by Bourouaine and Perez 2019 (BP19) when restricted to the strong turbulence regime. The model predicts that the two-time power spectrum exhibits an universal, self-similar behavior that is solely determined by the probability distribution function of random velocities in the energy-containing range. Understanding the scale-dependent temporal evolution of the space-time turbulence correlation as well as its associated universal properties is essential in the analysis and interpretation of spacecraft observations, such as the recently launched Parker Solar Probe (PSP).