Short radio pulses can be measured from showers of both high-energy cosmic rays and neutrinos. While commonly several antenna stations are needed to reconstruct the energy of an air shower, we describe a novel method that relies on the radio signal measured in one antenna station only. Exploiting a broad frequency bandwidth of $80-300$ MHz, we obtain a statistical energy resolution of better than 15% on a realistic Monte Carlo set. This method is both a step towards energy reconstruction from the radio signal of neutrino induced showers, as well as a promising tool for cosmic-ray radio arrays. Especially for hybrid arrays where the air shower geometry is provided by an independent detector, this method provides a precise handle on the energy of the shower even with a sparse array.