We present the use of linearly down-tapered gas-filled hollow-core photonic crystal fiber in a single-stage, pumped with pulses from a compact infrared laser source, to generate a supercontinuum carrying significant spectral power in the deep ultraviolet (200 - 300 nm). The generated supercontinuum extends from the near infrared down to around 213 nm with up to 0.83 mW/nm in the deep ultraviolet.