Exact black hole solutions in the Einstein-Maxwell-scalar theory are constructed. They are the extensions of dilaton black holes in de Sitter or anti de Sitter universe. As a result, except for a scalar potential, a coupling function between the scalar field and the Maxwell invariant is present. Then the corresponding Smarr formula and the first law of thermodynamics are investigated.