No Arabic abstract
We introduce reinforcement learning (RL) formulations of the problem of finding the ground state of a many-body quantum mechanical model defined on a lattice. We show that stoquastic Hamiltonians - those without a sign problem - have a natural decomposition into stochastic dynamics and a potential representing a reward function. The mapping to RL is developed for both continuous and discrete time, based on a generalized Feynman-Kac formula in the former case and a stochastic representation of the Schrodinger equation in the latter. We discuss the application of this mapping to the neural representation of quantum states, spelling out the advantages over approaches based on direct representation of the wavefunction of the system.
Finding the ground state of a quantum mechanical system can be formulated as an optimal control problem. In this formulation, the drift of the optimally controlled process is chosen to match the distribution of paths in the Feynman--Kac (FK) representation of the solution of the imaginary time Schrodinger equation. This provides a variational principle that can be used for reinforcement learning of a neural representation of the drift. Our approach is a drop-in replacement for path integral Monte Carlo, learning an optimal importance sampler for the FK trajectories. We demonstrate the applicability of our approach to several problems of one-, two-, and many-particle physics.
The phenomenon of many-body localisation received a lot of attention recently, both for its implications in condensed-matter physics of allowing systems to be an insulator even at non-zero temperature as well as in the context of the foundations of quantum statistical mechanics, providing examples of systems showing the absence of thermalisation following out-of-equilibrium dynamics. In this work, we establish a novel link between dynamical properties - the absence of a group velocity and transport - with entanglement properties of individual eigenvectors. Using Lieb-Robinson bounds and filter functions, we prove rigorously under simple assumptions on the spectrum that if a system shows strong dynamical localisation, all of its many-body eigenvectors have clustering correlations. In one dimension this implies directly an entanglement area law, hence the eigenvectors can be approximated by matrix-product states. We also show this statement for parts of the spectrum, allowing for the existence of a mobility edge above which transport is possible.
The control of many-body quantum dynamics in complex systems is a key challenge in the quest to reliably produce and manipulate large-scale quantum entangled states. Recently, quench experiments in Rydberg atom arrays (Bluvstein et. al., arXiv:2012.12276) demonstrated that coherent revivals associated with quantum many-body scars can be stabilized by periodic driving, generating stable subharmonic responses over a wide parameter regime. We analyze a simple, related model where these phenomena originate from spatiotemporal ordering in an effective Floquet unitary, corresponding to discrete time-crystalline (DTC) behavior in a prethermal regime. Unlike conventional DTC, the subharmonic response exists only for Neel-like initial states, associated with quantum scars. We predict robustness to perturbations and identify emergent timescales that could be observed in future experiments. Our results suggest a route to controlling entanglement in interacting quantum systems by combining periodic driving with many-body scars.
One of the key applications for the emerging quantum simulators is to emulate the ground state of many-body systems, as it is of great interest in various fields from condensed matter physics to material science. Traditionally, in an analog sense, adiabatic evolution has been proposed to slowly evolve a simple Hamiltonian, initialized in its ground state, to the Hamiltonian of interest such that the final state becomes the desired ground state. Recently, variational methods have also been proposed and realized in quantum simulators for emulating the ground state of many-body systems. Here, we first provide a quantitative comparison between the adiabatic and variational methods with respect to required quantum resources on digital quantum simulators, namely the depth of the circuit and the number of two-qubit quantum gates. Our results show that the variational methods are less demanding with respect to these resources. However, they need to be hybridized with a classical optimization which can converge slowly. Therefore, as the second result of the paper, we provide two different approaches for speeding the convergence of the classical optimizer by taking a good initial guess for the parameters of the variational circuit. We show that these approaches are applicable to a wide range of Hamiltonian and provide significant improvement in the optimization procedure.
We investigate the occurrence of the phenomenon of many-body localization (MBL) on a D-Wave 2000Q programmable quantum annealer. We study a spin-1/2 transverse-field Ising model defined on a Chimera connectivity graph, with random exchange interactions and random longitudinal fields. On this system we experimentally observe a transition from an ergodic phase to an MBL phase. We first theoretically show that the MBL transition is induced by a critical disorder strength for individual energy eigenstates in a Chimera cell, which follows from the analysis of the mean half-system block entanglement, as measured by the von Neumann entropy. We show the existence of an area law for the block entanglement over energy eigenstates for the MBL phase, which stands in contrast with an extensive volume scaling in the ergodic phase. The identification of the MBL critical point is performed via the measurement of the maximum variance of the mean block entanglement over the disorder ensemble as a function of the disorder strength. Our results for the energy density phase diagram also show the existence of a many-body mobility edge in the energy spectrum. The time-independent disordered Ising Hamiltonian is then experimentally realized by applying the reverse annealing technique allied with a pause-quench protocol on the D-Wave device. We then characterize the MBL critical point through magnetization measurements at the end of the annealing dynamics, obtaining results compatible with our theoretical predictions for the MBL transition.