Highly turbulent Taylor-Couette flow with spanwise-varying roughness is investigated experimentally and numerically (direct numerical simulations (DNS) with an immersed boundary method (IBM)) to determine the effects of the spacing and axial width $s$ of the spanwise varying roughness on the total drag and {on} the flow structures. We apply sandgrain roughness, in the form of alternating {rough and smooth} bands to the inner cylinder. Numerically, the Taylor number is $mathcal{O}(10^9)$ and the roughness width is varied between $0.47leq tilde{s}=s/d leq 1.23$, where $d$ is the gap width. Experimentally, we explore $text{Ta}=mathcal{O}(10^{12})$ and $0.61leq tilde s leq 3.74$. For both approaches the radius ratio is fixed at $eta=r_i/r_o = 0.716$, with $r_i$ and $r_o$ the radius of the inner and outer cylinder respectively. We present how the global transport properties and the local flow structures depend on the boundary conditions set by the roughness spacing $tilde{s}$. Both numerically and experimentally, we find a maximum in the angular momentum transport as function of $tilde s$. This can be atributed to the re-arrangement of the large-scale structures triggered by the presence of the rough stripes, leading to correspondingly large-scale turbulent vortices.