We observed quantum oscillations in thermoelectric and magnetic torque signals in non-centrosymmetric superconductor PbTaSe$_2$. One oscillatory frequency stems from the orbits formed by magnetic breakdown, while others are from two-dimensional-like Fermi surfaces near the topological nodal rings. Our comprehensive understanding of the Fermi surface topology of PbTaSe$_2$, including nailing down the Fermi level and detecting the Berry phases near the nodal rings, is crucial for searching plausible topological superconductivity in its bulk and surface states.