Eilers et al. have recently completed the geometric classification of unital graph $C^ast$-algebras up to Morita equivalence using a set of moves on the corresponding digraphs. We explore the question of whether these moves preserve the nonzero elements of the spectrum of a finite digraph, which in this paper is allowed to have loops and parallel edges. We consider several different digraph spectra that have been studied in the literature, answering this question for the Laplace and adjacency spectra, their skew counterparts, the symmetric adjacency spectrum, the adjacency spectrum of the line digraph, the Hermitian adjacency spectrum, and the normalized Laplacian, considering in most cases two ways that these spectra can be defined in the presence of parallel edges. We show that the adjacency spectra of the digraph and line digraph are preserved by a subset of the moves, and the skew adjacency and Laplace spectra are preserved by the Cuntz splice. We give counterexamples to show that the other spectra are not preserved by the remaining moves. The same results hold if one restricts to the class of strongly connected digraphs.