This is the second paper studying the QSOs in the spitzer QUEST sample. Previously we presented new PAH measurements and argued that most of the observed far infrared (FIR) radiation is due to star-forming activity. Here we present spectral energy distributions (SEDs) by supplementing our data with optical, NIR and FIR observations. We define two sub-groups of ``weak FIR and ``strong FIR QSOs, and a third group of FIR non-detections. Assuming a starburst origin for the FIR, we obtain ``intrinsic AGN SEDs by subtracting a starburst template from the mean SEDs. The resulting SEDs are remarkably similar for all groups. They show three distinct peaks corresponding to two silicate emission features and a 3mic bump that we interpret as the signature of the hottest AGN dust. They also display drops beyond 20mic that we interpret as the signature of the minimum temperature (about 200K) dust. This component must be optically thin to explain the silicate emission and the slope of the long wavelength continuum. We discuss the merits of an alternative model where most of the FIR emission is due to AGN heating. Such models are unlikely to explain the properties of our QSOs but they cannot be ruled out for more luminous objects. We also find correlations between the luminosity at 5100A and two infrared starburst indicators: L(60mic) and L(PAH 7.7mic). The correlation of L(5100A) with L(60mic) can be used to measure the relative growth rates and lifetimes of the black hole and the new stars.