In this paper we consider the existence and regularity of weakly polyharmonic almost complex structures on a compact almost Hermitian manifold $M^{2m}$. Such objects satisfy the elliptic system weakly $[J, Delta^m J]=0$. We prove a very general regularity theorem for semilinear systems in critical dimensions (with emph{critical growth nonlinearities}). In particular we prove that weakly biharmonic almost complex structures are smooth in dimension four.