The use of x-ray imaging in medicine and other research is well known. Generally, the image quality is proportional to the total flux, but high photon energy could severely damage the specimen, so how to decrease the radiation dose while maintaining image quality is a fundamental problem. In ghost imaging, an image is retrieved from a known patterned illumination field and the total intensity transmitted through the object collected by a bucket detector. Using a table-top x-ray source we have realized ghost imaging of plane and natural objects with ultra-low radiation on the order of single photons. Compared with conventional x-ray imaging, a higher contrast-to-noise ratio is obtained for the same radiation dose. This new technique could greatly reduce radiation damage of biological specimens.