We demonstrate the extension of coherence between all four two-electron spin ground states of an InAs quantum dot molecule (QDM) via non-local suppression of nuclear spin fluctuations in both constituent quantum dots (QDs), while optically addressing only the upper QD transitions. Long coherence times are revealed through dark-state spectroscopy as resulting from nuclear spin locking mediated by the exchange interaction between the QDs. Lineshape analysis provides the first measurement of the quieting of the Overhauser field distribution correlating with reduced nuclear spin fluctuations.