We propose an encoding for topological quantum computation utilizing quantum representations of mapping class groups. Leakage into a non-computational subspace seems to be unavoidable for universality in general. We are interested in the possible gate sets which can emerge in this setting. As a first step, we prove that for abelian anyons, all gates from these mapping class group representations are normalizer gates. Results of Van den Nest then allow us to conclude that for abelian anyons this quantum computing scheme can be simulated efficiently on a classical computer. With an eye toward more general anyon models we additionally show that for Fibonnaci anyons, quantum representations of mapping class groups give rise to gates which are not generalized Clifford gates.