The surprisingly low current densities required for inducing the insulator to metal transition has made Ca$_2$RuO$_4$ an attractive candidate material for developing novel Mott-based electronics devices. The mechanism underlying the resistive switching, however, remains to be a controversial topic in the field of correlated electron systems. Here we report a four orders of magnitude increase in the current density required for driving Ca$_2$RuO$_4$ out of the insulating state upon decreasing the crystal size. We investigate this unprecedented effect by conducting an extensive size-dependent study of electrical transport in high-purity Ca$_2$RuO$_4$ single crystals. We establish that the size dependence is not a result of Joule heating, by integrating a microscopic platinum thermometer. Our detailed study demonstrates that the universally observed transport characteristics of Ca$_2$RuO$_4$ are a result of a strongly inhomogenous current distribution in the nominally homogeneous crystal.