We report experimental and theoretical evidence that GaGeTe is a basic $Z_2$ topological semimetal with three types of charge carriers: bulk-originated electrons and holes as well as surface state electrons. This electronic situation is qualitatively similar to the primer 3D topological insulator Bi2Se3, but important differences account for an unprecedented transport scenario in GaGeTe. High-resolution angle-resolved photoemission spectroscopy combined with advanced band structure calculations show a small indirect energy gap caused by a peculiar band inversion in the textit{T}-point of the Brillouin zone in GaGeTe. An energy overlap of the valence and conduction bands brings both electron- and hole-like carriers to the Fermi level, while the momentum gap between the corresponding dispersions remains finite. We argue that peculiarities of the electronic spectrum of GaGeTe have a fundamental importance for the physics of topological matter and may boost the materials application potential.