In this paper, we obtain a number of new infinite families of Hadamard matrices. Our constructions are based on four new constructions of difference families with four or eight blocks. By applying the Wallis-Whiteman array or the Kharaghani array to the difference families constructed, we obtain new Hadamard matrices of order $4(uv+1)$ for $u=2$ and $vin Phi_1cup Phi_2 cup Phi_3 cup Phi_4$; and for $uin {3,5}$ and $vin Phi_1cup Phi_2 cup Phi_3$. Here, $Phi_1={q^2:qequiv 1pmod{4}mbox{ is a prime power}}$, $Phi_2={n^4in mathbb{N}:nequiv 1pmod{2}} cup {9n^4in mathbb{N}:nequiv 1pmod{2}}$, $Phi_3={5}$ and $Phi_4={13,37}$. Moreover, our construction also yields new Hadamard matrices of order $8(uv+1)$ for any $uin Phi_1cup Phi_2$ and $vin Phi_1cup Phi_2 cup Phi_3$.