The discovery of two neutron star-black hole coalescences by LIGO and Virgo brings the total number of likely neutron stars observed in gravitational waves to six. We perform the first inference of the mass distribution of this extragalactic population of neutron stars. In contrast to the bimodal Galactic population detected primarily as radio pulsars, the masses of neutron stars in gravitational-wave binaries are thus far consistent with a uniform distribution, with a greater prevalence of high-mass neutron stars. The maximum mass in the gravitational-wave population agrees with that inferred from the neutron stars in our Galaxy and with expectations from dense matter.