Atmospheric neutrinos travel very long distances through earth matter. It is expected that the matter effects lead to significant changes in the neutrino survival and oscillation probabilities. Initial analysis of atmospheric neutrino data by the Super- Kamiokande collaboration is done using the vacuum oscillation hypothesis, which provided a good fit to the data. In this work, we did a study to differentiate the effects of vacuum oscillations and matter modified oscillations in the atmospheric neutrino data. We find that magnetized iron detector, ICAL at INO, can make a 3 sigma discrimination between vacuum oscillations and matter oscillations, for both normal and inverted hierarchies, in ten years.