We report on deep IR imaging of the double quasar HE 1104-1805. A new image deconvolution technique has been applied to the data in order to optimally combine the numerous frames obtained. The resulting J and K images allow us to detect and study the lensing galaxy between the two lensed QSO images. The near infrared images not only confirm the lensed nature of this double quasar, but also support the previous redshift estimate of z=1.66 for the lensing galaxy. No obvious overdensity of galaxies is detected in the immediate region surrounding the lens, down to limiting magnitudes of J=22 and K=20. The geometry of the system, together with the time delays expected for this lensed quasar, make HE 1104-1805 a remarkable target for future photometric monitoring programs, for the study of microlensing and for the determination of the cosmological parameters in the IR and optical domains.