It is concluded in the literature that Ellis wormhole is unstable under small perturbations and would decay either to the Schwarzschild black hole or expand away to infinity. While this deterministic conclusion of instability is correct, we show that the Ellis wormhole reduces to Schwarzschild black hole textit{only} when the Ellis solution parameter $gamma $ assumes a complex value $-i$. We shall then reexamine stability of Ellis and phantom wormholes from the viewpoint of local and asymptotic observers by using a completely different approach, viz., we adapt Tangherlinis nondeterministic, prequantal statistical simulation about photon motion in the real optical medium to an effective medium reformulation of motions obtained via Hamiltons optical-mechanical analogy in a gravity field. A crucial component of Tangherlinis idea is the observed increase of momentum of the photons entering a real medium. We show that this fact has a heuristic parallel in the effective medium version of the Pound-Rebka experiment in gravity. Our conclusion is that there is a non-zero probability that Ellis and phantom wormholes could appear stable or unstable depending on the location of observers and on the values of $gamma$, leading to the possibility of textit{ghost wormholes} (like ghost stars). The Schwarzschild horizon, however, would always appear certainly stable ($R=1$, $T=0$) to observers regardless of their location. Phantom wormholes of bounded mass in the extreme limit $arightarrow -1$ are also shown to be stable just as the Schwarzschild black hole is. We shall propose a thought experiment showing that our non-deterministic results could be numerically translated into observable deterministic signatures of ghost wormholes.