We investigate the relationship between the Zeeman interaction and the inversion asymmetry induced spin orbit interactions (Rashba and Dresselhaus SOIs) in GaAs hole quantum point contacts. The presence of a strong SOI results in crossing and anti-crossing of adjacent spin-split hole subbands in a magnetic field. We demonstrate theoretically and experimentally that the anti-crossing energy gap depends on the interplay between the SOI terms and the highly anisotropic hole g tensor, and that this interplay can be tuned by selecting the crystal axis along which the current and magnetic field are aligned. Our results constitute independent detection and control of the Dresselhaus and Rashba SOIs in hole systems, which could be of importance for spintronics and quantum information applications.