Electron-spin nitrogen-vacancy color centers in diamond are a natural candidate to act as a quantum memory for superconducting qubits because of their large collective coupling and long coherence times. We report here the first demonstration of strong coupling and coherent exchange of a single quantum of energy between a flux-qubit and an ensemble of nitrogen-vacancy color centers.