We create a multi-partite entangled state by storing a single photon in a crystal that contains many large atomic ensembles with distinct resonance frequencies. The photon is re-emitted at a well-defined time due to an interference effect analogous to multi-slit diffraction. We derive a lower bound for the number of entangled ensembles based on the contrast of the interference and the single-photon character of the input, and we experimentally demonstrate entanglement between over two hundred ensembles, each containing a billion atoms. In addition, we illustrate the fact that each individual ensemble contains further entanglement. Our results are the first demonstration of entanglement between many macroscopic systems in a solid and open the door to creating even more complex entangled states.