Initializing quantum registers with high fidelity is a fundamental precondition for many applications like quantum information processing and sensing. The electronic and nuclear spins of a Nitrogen-Vacancy (NV) center in diamond form an interesting hybrid quantum register that can be initialized by a combination of laser, microwave, and radio-frequency pulses. However, the laser illumination, which is necessary for achieving electron spin polarization, also has the unwanted side-effect of depolarizing the nuclear spin. Here, we study how the depolarization dynamics of the $^{14}$N nuclear spin depends on the laser wavelength. We show experimentally that excitation with an orange laser (594 nm) causes significantly less nuclear spin depolarization compared to the green laser (532 nm) typically used for excitation and hence leads to higher nuclear spin polarization. This could be because orange light excitation inhibits ionization of NV$^{0}$ into NV$^{-}$ and therefore suppresses one source of noise acting on the nuclear spin.