Non-vanishing boundary localised terms significantly modify the mass spectrum and various interactions among the Kaluza-Klein excited states of 5-Dimensional Universal Extra Dimensional scenario. In this scenario we compute the contributions of Kaluza-Klein excitations of gauge bosons and third generation quarks for the decay process $Brightarrow X_sell^+ell^-$ incorporating next-to-leading order QCD corrections. We estimate branching ratio as well as Forward Backward asymmetry associated with this decay process. Considering the constraints from some other $b to s$ observables and electroweak precision data we show that significant amount of parameter space of this scenario has been able to explain the observed experimental data for this decay process. From our analysis we put lower limit on the size of the extra dimension by comparing our theoretical prediction for branching ratio with the corresponding experimental data. Depending on the values of free parameters of the present scenario, lower limit on the inverse of the radius of compactification ($R^{-1}$) can be as high as $geq 760$ GeV. {Even this value could slightly be higher if we project the upcoming measurement by Belle II experiment.} Unfortunately, the Forward Backward asymmetry of this decay process would not provide any significant limit on $R^{-1}$ in the present model.