In this second part of a series work, we further develop the theory of higher fusion categories, including center functors, centralizers and group theoretic higher fusion categories. Along the way we prove several conjectures on modular extensions and the representation categories of finite higher groups.