Effects of annealing on chemical vapor deposited graphene are investigated via a weak localization magnetoresistance measurement. Annealing at SI{300}{celsius} in inert gases, a common cleaning procedure for graphene devices, is found to raise the dephasing rate significantly above the rate from electron-electron interactions, which would otherwise be expected to dominate dephasing at 4 K and below. This extra dephasing is apparently induced by local magnetic moments activated by the annealing process, and depends strongly on the backgate voltage applied.