In this paper, we investigate automorphisms of compact Kahler manifolds with different levels of topological triviality. In particular, we provide several examples of smooth complex projective surfaces X whose groups of $C^infty$-isotopically trivial automorphisms, resp. cohomologically trivial automorphisms, have a number of connected components which can be arbitrarily large.