We present a two-dimensional mapping of the gas flux distributions, as well as of the gas and stellar kinematics in the inner 220 pc of the Seyfert galaxy NGC 2110, using K-band integral field spectroscopy obtained with the Gemini NIFS at a spatial resolution of ~24pc and spectral resolution of ~40 km/s. The H2 emission extends over the whole field-of-view and is attributed to heating by X-rays from the AGN and/or by shocks, while the Brgamma emission is restricted to a bi-polar region extending along the South-East-North-West direction. The masses of the warm molecular gas and of the ionized gas are ~1.4x10^3 Msun and ~1.8x10^6 Msun, respectively. The stellar kinematics present velocity dispersions reaching 250km/s and a rotation pattern reaching an amplitude of 200 km/s. The gas velocity fields present a similar rotation pattern but also additional components that we attribute to inflows and outflows most clearly observed in the molecular gas emission. The inflows are observed beyond the inner 70 pc and are associated to a spiral arm seen in blueshift to the North-East and another in redshift to the South-West. We have estimated a mass inflow rate in warm molecular gas of ~4.6x10^-4 Msun/year. Within the inner 70 pc, another kinematic component is observed in the H2 emission that can be interpreted as due to a bipolar nuclear outflow oriented along the East-West direction, with a mass-outflow rate of ~4.3x10^-4 Msun/year in warm H2.