We present a novel microfabricated optical cavity, which combines a very small mode volume with high finesse. In contrast to other micro-resonators, such as microspheres, the structure we have built gives atoms and molecules direct access to the high-intensity part of the field mode, enabling them to interact strongly with photons in the cavity for the purposes of detection and quantum-coherent manipulation. Light couples directly in and out of the resonator through an optical fibre, avoiding the need for sensitive coupling optics. This renders the cavity particularly attractive as a component of a lab-on-a-chip, and as a node in a quantum network.