Combining first-principles density functional theory simulations with IR and Raman experiments, we determine the frequency shift of vibrational modes of CO2 when physiadsorbed in the iso-structural metal organic framework materials Mg-MOF74 and Zn-MOF74. Surprisingly, we find that the resulting change in shift is rather different for these two systems and we elucidate possible reasons. We explicitly consider three factors responsible for the frequency shift through physiabsorption, namely (i) the change in the molecule length, (ii) the asymmetric distortion of the CO$_2$ molecule, and (iii) the direct influence of the metal center. The influence of each factor is evaluated separately through different geometry considerations, providing a fundamental understanding of the frequency shifts observed experimentally.