As the parameters of a map are varied an attractor may vary continuously in the Hausdorff metric. The purpose of this paper is to explore the continuation of chaotic attractors. We argue that this is not a helpful concept for smooth unimodal maps for which periodic windows fill parameter space densely, but that for piecewise-smooth maps it provides a way to delineate structure within parameter regions of robust chaos and form a stronger notion of robustness. We obtain conditions for the continuity of an attractor and demonstrate the results with coupled skew tent maps, the Lozi map, and the border-collision normal form.