We study Toeplitz operators on Hilbert spaces of holomorphic functions on symmetric domains, and more generally on certain algebraic subvarieties, determined by integration over boundary orbits of the underlying domain. The main result classifies the irreducible representations of the Toeplitz $C^*$-algebra generated by Toeplitz operators with continuous symbol. This relies on the limit behavior of hypergeometric measures under certain peaking functions.