Disorder increasingly affects performance as electronic devices are reduced in size. The ionized dopants used to populate a device with electrons are particularly problematic, leading to unpredictable changes in the behavior of devices such as quantum dots each time they are cooled for use. We show that a quantum dot can be used as a highly sensitive probe of changes in disorder potential, and that by removing the ionized dopants and populating the dot electrostatically, its electronic properties become reproducible with high fidelity after thermal cycling to room temperature. Our work demonstrates that the disorder potential has a significant, perhaps even dominant, influence on the electron dynamics, with important implications for `ballistic transport in quantum dots.