We demonstrate spontaneous bidirectional motion of droplets on liquid infused surfaces in the presence of a topographical gradient, in which the droplets can move either toward the denser or the sparser solid fraction area. Our analytical theory explains the origin of this bidirectional motion. Furthermore, using both lattice Boltzmann simulations and experiments, we show that the key factor determining the direction of motion is the wettability difference of the droplet on the solid surface and on the lubricant film. The bidirectional motion is shown for various combinations of droplets and lubricants, as well as for different forms of topographical gradients.