We investigate the finite size effect on the vector meson and the baryon sectors using a subset of the PACS10 configurations which are generated, keeping the space-time volumes over (10 fm$)^4$ in 2+1 flavor QCD at the physical point. Comparing the results on (5.5 fm$)^4$ and (10.9 fm$)^4$ lattices the ground states of octet baryons , which are stable on the lattice, show no finite size effect within less than 0.5% level of statistical errors. For those of vector mesons, which are unstable on the lattice, we observe that the effective masses are well below the experimental resonance levels both on (5.5 fm$)^4$ and (10.9 fm$)^4$ lattices. For the decuplet baryon sector we have found that the time dependence of the effective mass looks quite similar to that for the vector meson sector including the $Omega$ baryon channel. We discuss its origin due to a possible mixing with the nearby multihadron states. Since the $Xi$ baryon mass can be determined with the smallest ambiguity among the vector meson and the baryon masses, we use it together with the pion and kaon masses as the physical inputs to determine the physical point.