The non-perturbative $csw$ determined by the Schr{o}dinger functional (SF) method with the RG-improved gauge action in dynamical $N_f=3$ QCD shows a finite volume effect when the numerical simulations are carried out at a constant lattice size $L/a$. We remove the unwanted finite volume effect by keeping physical lattice extent $L$ at a constant. The details of the method and the result obtained for non-perturbative $csw$ with a constant $L$ are reported.