We measure fast carrier decay rates (6 ps) in GaAs photonic crystal cavities with resonances near the GaAs bandgap energy at room temperature using a pump-probe measurement. Carriers generated via photoexcitation using an above-band femtosecond pulse cause a substantial blue-shift in the cavity peak. The experimental results are compared to theoretical models based on free carrier effects near the GaAs band edge. The probe transmission is modified for an estimated above-band pump energy of 4.2 fJ absorbed in the GaAs slab.