We theoretically study the stability of more than one Majorana Fermion appearing in a $p$-wave superconductor/dirty normal metal/$p$-wave superconductor junction in two-dimension by using chiral symmetry of Hamiltonian. At the phase difference across the junction $varphi$ being $pi$, we will show that all of the Majorana bound states in the normal metal belong to the same chirality. Due to this pure chiral feature, the Majorana bound states retain their high degree of degeneracy at the zero energy even in the presence of random potential. As a consequence, the resonant transmission of a Cooper pair via the degenerate MBSs carries the Josephson current at $varphi=pi-0^+$, which explains the fractional current-phase relationship discussed in a number of previous papers.