Massive Dirac fermions break the chiral symmetry explicitly and also make the Berry curvature of the band structure non-Abelian. By utilizing the Greens function technique, we develop a microscopic theory to establish a set of quantum diffusive equations for massive Dirac materials in the presence of electric and magnetic fields. It is found that the longitudinal magnetoresistance is always negative and quadratic in the magnetic field, and decays quickly with the mass. The theory is applicable to the systems with non-Abelian Berry curvature and resolves the puzzles of anomalous magnetotransport properties measured in topological materials.