Ellerman Bombs (EBs) are often found co-spatial with bipolar photospheric magnetic fields. We use H$alpha$ imaging spectroscopy along with Fe I 6302.5 AA spectro-polarimetry from the Swedish 1-m Solar Telescope (SST), combined with data from the Solar Dynamic Observatory (SDO) to study EBs and the evolution of the local magnetic fields at EB locations. The EBs are found via an EB detection and tracking algorithm. We find, using NICOLE