We generate high-order harmonics of a mid-infrared laser from a silicon single crystal and find their origin in the recollision of coherently accelerated electrons with their holes, analogously to the atomic and molecular case, and to ZnO [Vampa et al., Nature 522, 462-464 (2015)], a direct bandgap material. Therefore indirect bandgap materials are shown to sustain the recollision process as well as direct bandgap materials. Furthermore, we find that the generation is perturbed with electric fields as low as 30 V/$mu$m, equal to the DC damage threshold. Our results extend high-harmonic spectroscopy to the most technologically relevant material, and open the possibility to integrate high harmonics with conventional electronics.