A formalism is given to hermitize the HAL QCD potential, which needs to be non-hermitian except the leading order (LO) local term in the derivative expansion as the Nambu-Bethe-Salpeter (NBS) wave functions for different energies are not orthogonal to each other. It is shown that the non-hermitian potential can be hermitized order by order to all orders in the derivative expansion. In particular, the next-to-leading order (NLO) potential can be exactly hermitized without approximation. The formalism is then applied to a simple case of $Xi Xi (^{1}S_{0}) $ scattering, for which the HAL QCD calculation is available to the NLO. The NLO term gives relatively small corrections to the scattering phase shift and the LO analysis seems justified in this case. We also observe that the local part of the hermitized NLO potential works better than that of the non-hermitian NLO potential. The hermitian version of the HAL QCD potential is desirable for comparing it with phenomenological interactions and also for using it as a two-body interaction in many body systems.