In this manuscript we will present the theoretical framework of the recently proposed infinite derivative theory of gravity with a non-symmetric connection. We will explicitly derive the field equations at the linear level and obtain new solutions with a non-trivial form of the torsion tensor in the presence of a fermionic source, and show that these solutions are both ghost and singularity-free.