Photonic crystal (PhC) defect cavities that support an accelerating mode tend to trap unwanted higher-order modes (HOMs) corresponding to zero-group-velocity PhC lattice modes at the top of the bandgap. The effect is explained quite generally from photonic band and perturbation theoretical arguments. Transverse wakefields resulting from this effect are observed in a hybrid dielectric PhC accelerating cavity based on a triangular lattice of sapphire rods. These wakefields are, on average, an order of magnitude higher than those in the waveguide-damped Compact Linear Collider (CLIC) copper cavities. The avoidance of translational symmetry (and, thus, the bandgap concept) can dramatically improve HOM damping in PhC-based structures.