We develop and validate a new algorithm called primary track recovery (ptr) that effectively deconvolves known physics and detector effects from nuclear recoil track in gas Time Projection Chambers (TPCs) with high-resolution readout. This gives access to the primary track charge, length, and vector direction (helping to resolve the head-tail ambiguity). Additionally, ptr provides a measurement of the longitudinal and transverse diffusion widths, which can be used to determine the absolute position of tracks in the drift direction for detector fiducialization. Using simulated neutron recoils we compare the performance of ptr to traditional methods for all key track variables and find that it substantially reduces a wide range of reconstruction errors, including those caused by charge integration. We show that ptr significantly improves on existing methods for head-tail disambiguation, particularly for highly inclined tracks. We demonstrate that ptr improves on existing methods for determining the absolute position of recoils on the drift axis via transverse diffusion by properly removing previously undescribed track width biases. We use experimental data to qualitatively verify these findings and discuss implications for future directional detectors at the low-energy frontier.