We obtain rotating black hole solutions to the novel 3D Gauss-Bonnet theory of gravity recently proposed. These solutions generalize the BTZ metric and are not of constant curvature. They possess an ergoregion and outer horizon, but do not have an inner horizon. We present their basic properties and show that they break the universality of thermodynamics present for their static charged counterparts, whose properties we also discuss. Extending our considerations to higher dimensions, we also obtain novel 4D Gauss-Bonnet rotating black strings.