We have measured the surface density of galaxies toward 14 X-ray-selected cluster candidates at redshifts greater than z=0.46, and we show that they are associated with rich galaxy concentrations. We find that the clusters range between Abell richness classes 0-2, and have a most probable richness class of one. We compare the richness distribution of our distant clusters to those for three samples of nearby clusters with similar X-ray luminosities. We find that the nearby and distant samples have similar richness distributions, which shows that clusters have apparently not evolved substantially in richness since redshift z =0.5. We compare the distribution of distant X-ray clusters in the L_x--richness plane to the distribution of optically-selected clusters from the Palomar Distant Cluster Survey. The optically-selected clusters appear overly rich for their X-ray luminosities when compared to X-ray-selected clusters. Apparently, X-ray and optical surveys do not necessarily sample identical mass concentrations at large redshifts. This may indicate the existence of a population of optically rich clusters with anomalously low X-ray emission. More likely, however, it reflects the tendency for optical surveys to select unvirialized mass concentrations, as might be expected when peering along large-scale filaments.