Geometric quantum speed limits quantify the trade-off between the rate with which quantum states can change and the resources that are expended during the evolution. Counterdiabatic driving is a unique tool from shortcuts to adiabaticity to speed up quantum dynamics while completely suppressing nonequilibrium excitations. We show that the quantum speed limit for counterdiabatically driven systems undergoing quantum phase transitions fully encodes the Kibble-Zurek mechanism by correctly predicting the transition from adiabatic to impulse regimes. Our findings are demonstrated for three scenarios, namely the transverse field Ising, the Landau-Zener, and the Lipkin-Meshkov-Glick models.