We discuss effects of the brane-localized mass terms on the fixed points of the toroidal orbifold $T^2/Z_2$ under the presence of background magnetic fluxes, where multiple lowest and higher-level Kaluza-Klein (KK) modes are realized before introducing the localized masses in general. Through the knowledge of linear algebra, we find that, in each KK level, one of or more than one of the degenerate KK modes are almost inevitably perturbed, when single or multiple brane-localized mass terms are introduced. When the typical scale of the compactification is far above the electroweak scale or the TeV scale, we apply this mechanism for uplifting unwanted massless or light modes which are prone to appear in models on magnetized orbifolds.