We present the results from timing observations with the GMRT of the young pulsar J1833-1034, in the galactic supernova remnant G21.5-0.9. We detect the presence of 4 glitches in this pulsar over a period of 5.5 years, making it one of a set of pulsars that show fairly frequent glitches. The glitch amplitudes, characterized by the fractional change of the rotational frequency, range from 1 times 10^-9 to 7 times 10^-9, with no evidence for any appreciable relaxation of the rotational frequency after the glitches. The fractional changes observed in the frequency derivative are of the order of 10-5 . We show conclusively that, in spite of having significant timing noise, the sudden irregularities like glitches detected in this pulsar can not be modeled as smooth timing noise. Our timing solution also provides a stable estimate of the second derivative of the pulsar spin-down model, and a plausible value for the braking index of 1.857, which, like the value for other such young pulsars, is much less than the canonical value of 3.0. PSR J1833-1034 appears to belong to a class of pulsars exhibiting fairly frequent occurrence of low amplitude glitches. This is further supported by an estimate of the glitch activity parameter, Ag = 1.53 times 10^-15 s^-2, which is found to be significantly lower than the trend of glitch activity versus characteristic age (or spin frequency derivative) that a majority of the glitching pulsars follow. We present evidence for a class of such young pulsars, including the Crab, where higher internal temperature of the neutron star could be responsible for the nature of the observed glitch activity.