We study (2+1)-dimensional multicomponent spatial vector solitons with a nontrivial topological structure of their constituents, and demonstrate that these solitary waves exhibit a symmetry-breaking instability provided their total topological charge is nonzero. We describe a novel type of stable multicomponent dipole-mode solitons with intriguing swinging dynamics.