Using spectroscopy from the Large Binocular Telescope and imaging from the Hubble Space Telescope we discovered the first strong galaxy lens at z(lens)>1. The lens has a secure photometric redshift of z=1.53+/-0.09 and the source is spectroscopically confirmed at z=3.417. The Einstein radius (0.35; 3.0 kpc) encloses 7.6 x 10^10 Msol, with an upper limit on the dark matter fraction of 60%. The highly magnified (40x) source galaxy has a very small stellar mass (~10^8 Msol) and shows an extremely strong [OIII]_5007A emission line (EW_0 ~ 1000A) bolstering the evidence that intense starbursts among very low-mass galaxies are common at high redshift.