Extensive experimental and numerical studies of the non-equilibrium dynamics of spin glasses subjected to temperature or bond perturbations have been performed to investigate chaos and memory effects in selected spin glass systems. Temperature shift and cycling experiments were performed on the strongly anisotropic Ising-like system {ising} and the weakly anisotropic Heisenberg-like system {AgMn}, while bond shift and cycling simulations were carried out on a 4 dimensional Ising Edwards-Anderson spin glass. These spin glass systems display qualitatively the same characteristic features and the observed memory phenomena are found to be consistent with predictions from the ghost domain scenario of the droplet scaling model.