In $D=4$, $cal{N}=1$ conformal superspace, the Yang-Mills matter coupled supergravity system is constructed where the Yang-Mills gauge interaction is introduced by extending the superconformal group to include the Kahler isometry group of chiral matter fields. There are two gauge-fixing procedures to get to the component Poincare supergravity: one via the superconformal component formalism and the other via the Poincare superspace formalism. These two types of superconformal gauge-fixing conditions are analyzed in detail and their correspondence is clarified.