In this paper we present an extension to the case of $L^1$-controls of a famous result by Ball--Marsden--Slemrod on the obstruction to the controllability of bilinear control systems in infinite dimensional spaces.