We perform ab initio calculations of hydrogen-based tunneling defects in alumina to identify deleterious two-level systems (TLS) in superconducting qubits. The defects analyzed include bulk hydrogenated Al vacancies, bulk hydrogen interstitial defects, and a surface OH rotor. The formation energies of the defects are first computed for an Al- and O-rich environment to give the likelihood of defect occurrence during growth. The potential energy surfaces are then computed and the corresponding dipole moments are evaluated to determine the coupling of the defects to an electric field. Finally, the tunneling energy is computed for the hydrogen defect and the analogous deuterium defect, providing an estimate of the TLS energy and the corresponding frequency for photon absorption. We predict that hydrogenated cation vacancy defects will form a significant density of GHz-frequency TLSs in alumina.