Given a C$^*$-correspondence $X$, we give necessary and sufficient conditions for the tensor algebra $mathcal T_X^+$ to be hyperrigid. In the case where $X$ is coming from a topological graph we obtain a complete characterization.