We present an overview of the occurrence and properties of atomic gas associated with compact radio sources at redshifts up to z=0.85. Searches for HI 21cm absorption were made with the Westerbork Synthesis Radio Telescope at UHF-high frequencies (725-1200 MHz). Detections were obtained for 19 of the 57 sources with usable spectra (33%). We have found a large range in line depths, from tau=0.16 to tau<=0.001. There is a substantial variety of line profiles, including Gaussians of less than 10km/s, to more typically 150km/s, as well as irregular and multi-peaked absorption profiles, sometimes spanning several hundred km/s. Assuming uniform coverage of the entire radio source, we obtain column depths of atomic gas between 1e19 and 3.3e21(Tsp/100K)(1/f)cm^(-2). There is evidence for significant gas motions, but in contrast to earlier results at low redshift, there are many sources in which the HI velocity is substantially negative (up to v=-1420km/s) with respect to the optical redshift, suggesting that in these sources the atomic gas, rather than falling into the centre, may be be flowing out, interacting with the jets, or rotating around the nucleus.