We show that the charge density wave (CDW) ground state below the Peierls transition temperature, $T_{CDW}$, of rare-earth tritellurides is not at its equilibrium value, but depends on the time where the system was kept at a fixed temperature below $T_{CDW}$. This ergodicity breaking is revealed by the increase of the threshold electric field for CDW sliding which depends exponentially on time. We tentatively explain this behavior by the reorganization of the oligomeric (Te$_x$)$^{2-}$ sequence forming the CDW modulation.