We introduce a semi-classical limit for many-body localization in the absence of global symmetries. Microscopically, this limit is realized by disordered Floquet circuits composed of Clifford gates. In $d=1$, the resulting dynamics are always many-body localized with a complete set of strictly local integrals of motion. In $dgeq 2$, the system realizes both localized and delocalized phases separated by a continuous transition in which ergodic puddles percolate. We argue that the phases are stable to deformations away from the semi-classical limit and estimate the resulting phase boundary. The Clifford circuit model is a distinct tractable limit from that of free fermions and suggests bounds on the critical exponents for the generic transition.