Deep reinforcement learning for quantum Hamiltonian engineering

Engineering desired Hamiltonian in quantum many-body systems is essential for applications such as quantum simulation, computation and sensing. Conventional quantum Hamiltonian engineering sequences are designed using human intuition based on perturbation theory, which may not describe the optimal solution and is unable to accommodate complex experimental imperfections. Here we numerically search for Hamiltonian engineering sequences using deep reinforcement learning (DRL) techniques and experimentally demonstrate that they outperform celebrated sequences on a solid-state nuclear magnetic resonance quantum simulator. As an example, we aim at decoupling strongly-interacting spin-1/2 systems. We train DRL agents in the presence of different experimental imperfections and verify robustness of the output sequences both in simulations and experiments. Surprisingly, many of the learned sequences exhibit a common pattern that had not been discovered before, to our knowledge, but has an meaningful analytical description. We can thus restrict the searching space based on this control pattern, allowing to search for longer sequences, ultimately leading to sequences that are robust against dominant imperfections in our experiments. Our results not only demonstrate a general method for quantum Hamiltonian engineering, but also highlight the importance of combining black-box artificial intelligence with understanding of physical system in order to realize experimentally feasible applications.

Prethermal quasiconserved observables in Floquet quantum systems

Prethermalization, by introducing emergent quasiconserved observables, plays a crucial role in protecting Floquet many-body phases over exponentially long time, while the ultimate fate of such quasiconserved operators can signal thermalization to infinite temperature. To elucidate the properties of prethermal quasiconservation in many-body Floquet systems, here we systematically analyze infinite temperature correlations between observables. We numerically show that the late-time behavior of the autocorrelations unambiguously distinguishes quasiconserved observables from non-conserved ones, allowing to single out a set of linearly-independent quasiconserved observables. By investigating two Floquet spin models, we identify two different mechanism underlying the quasi-conservation law. First, we numerically verify energy quasiconservation when the driving frequency is large, so that the system dynamics is approximately described by a static prethermal Hamiltonian. More interestingly, under moderate driving frequency, another quasiconserved observable can still persist if the Floquet driving contains a large global rotation. We show theoretically how to calculate this conserved observable and provide numerical verification. Having systematically identified all quasiconserved observables, we can finally investigate their behavior in the infinite-time limit and thermodynamic limit, using autocorrelations obtained from both numerical simulation and experiments in solid state nuclear magnetic resonance systems.

Observation of Floquet prethermalization in dipolar spin chains

Periodically driven Floquet quantum systems provide a promising platform to investigate novel physics out of equilibrium. Unfortunately, the drive generically heats up the system to a featureless infinite temperature state. For large driving frequency, the heat absorption rate is predicted to be exponentially small, giving rise to a long-lived prethermal regime which exhibits all the intriguing properties of Floquet systems. Here we experimentally observe Floquet prethermalization using nuclear magnetic resonance techniques. We first show the relaxation of a far-from-equilibrium initial state to a long-lived prethermal state, well described by the time-independent prethermal Hamiltonian. By measuring the autocorrelation of this prethermal Hamiltonian we can further experimentally confirm the predicted exponentially slow heating rate. More strikingly, we find that in the timescale when the effective Hamiltonian picture breaks down, the Floquet system still possesses other quasi-conservation laws. Our results demonstrate that it is possible to realize robust Floquet engineering, thus enabling the experimental observation of non-trivial Floquet phases of matter.