This paper proposes a novel stochastic version of damped and regularized BFGS method for addressing the above problems.