We present a method for the measurement of the phase gradient of a wavefront by tracking the relative motion of speckles in projection holograms as a sample is scanned across the wavefront. By removing the need to obtain an un-distorted reference image of the sample, this method is suitable for the metrology of highly divergent wavefields. Such wavefields allow for large magnification factors, that, according to current imaging capabilities, will allow for nano-radian angular sensitivity and nano-scale sample projection imaging. Both the reconstruction algorithm and the imaging geometry are nearly identical to that of ptychography, except that the sample is placed downstream of the beam focus and that no coherent propagation is explicitly accounted for. Like other x-ray speckle tracking methods, it is robust to low-coherence x-ray sources making is suitable for lab based x-ray sources. Likewise it is robust to errors in the registered sample positions making it suitable for x-ray free-electron laser facilities, where beam pointing fluctuations can be problematic for wavefront metrology. We also present a modified form of the speckle tracking approximation, based on a second-order local expansion of the Fresnel integral. This result extends the validity of the speckle tracking approximation and may be useful for similar approaches in the field.