Hot spot of Berry curvature is usually found at Bloch band anti-crossings, where the Hall effect due to the Berry phase can be most pronounced. With small gaps there, the adiabatic limit for the existing formulations of Hall current can be exceeded in a moderate electric field. Here we present a theory of non-adiabatic Hall effect, capturing non-perturbatively the across gap electron-hole excitations by the electric field. We find a general connection between the field induced electron-hole coherence and intrinsic Hall velocity. In coherent evolution, the electron-hole coherence can manifest as a sizeable ac Hall velocity. When environmental noise is taken into account, its joint action with the electric field favors a form of electron-hole coherence that is function of wavevector and field only, leading to a dc nonlinear Hall effect. The Hall current has all odd order terms in field, and still retains the intrinsic role of the Berry curvature. The quantitative demonstration uses the example of gapped Dirac cones, and our theory can be used to describe the bulk pseudospin Hall current in insulators with gapped edge such as graphene and 2D MnBi$_{2}$Te$_{4}$