We introduce the space of rough paths with Sobolev regularity and the corresponding concept of controlled Sobolev paths. Based on these notions, we study rough path integration and rough differential equations. As main result, we prove that the solution map associated to differential equations driven by rough paths is a locally Lipschitz continuous map on the Sobolev rough path space for any arbitrary low regularity $alpha$ and integrability $p$ provided $alpha >1/p$.