Recent experiments suggest that the superconducting order parameter of Sr$_2$RuO$_4$ has two components. A two-component order parameter has multiple degrees of freedom in the superconducting state that can result in low-energy collective modes or the formation of domain walls -- a possibility that would explain a number of experimental observations including the smallness of the time reversal symmetry breaking signal at T$_mathrm{c}$ and telegraph noise in critical current experiments. We perform ultrasound attenuation measurements across the superconducting transition of Sr$_2$RuO$_4$ using resonant ultrasound spectroscopy (RUS). We find that the attenuation for compressional sound increases by a factor of seven immediately below T$_mathrm{c}$, in sharp contrast with what is found in both conventional ($s$-wave) and high-T$_mathrm{c}$ ($d$-wave) superconductors. We find our observations to be most consistent with the presence of domain walls between different configurations of the superconducting state. The fact that we observe an increase in sound attenuation for compressional strains, and not for shear strains, suggests an inhomogeneous superconducting state formed of two distinct, accidentally-degenerate superconducting order parameters that are not related to each other by symmetry. Whatever the mechanism, a factor of seven increase in sound attenuation is a singular characteristic with which any potential theory of the superconductivity in Sr$_2$RuO$_4$ must be reconciled.