Dark matter could be composed of compact dark objects (CDOs). We find that the oscillation of CDOs inside neutron stars can be a detectable source of gravitational waves (GWs). The GW strain amplitude depends on the mass of the CDO, and its frequency is typically in the range 3-5 kHz as determined by the central density of the star. In the best cases, LIGO may be sensitive to CDO masses greater than or of order $10^{-8}$ solar masses.