Most star clusters at an intermediate age (1-2 Gyr) in the Large and Small Magellanic Clouds show a puzzling feature in their color-magnitude diagrams (CMD) that is not in agreement with a simple stellar population. The main sequence turn-off of these clusters is much broader than would be expected from photometric uncertainties. One interpretation of this feature is that age spreads of the order 200-500 Myr exist within individual clusters, although this interpretation is highly debated. Such large age spreads should affect other parts of the CMD, which are sensitive to age, as well. In this study, we analyze the CMDs of a sample of 12 intermediate-age clusters in the Large Magellanic Cloud that all show an extended turn-off using archival optical data taken with the Hubble Space Telescope. We fit the star formation history of the turn-off region and the red clump region independently with two different theoretical isochrone models. We find that in most of the cases, the age spreads inferred from the red clumps are smaller than the ones resulting from the turn-off region. However, the age ranges resulting from the red clump region are broader than would be expected for a single age. Only two out of 12 clusters in our sample show a red clump which seems to be consistent with a single age. As our results are not unambiguous, we can not ultimately tell if the extended main sequence turn-off feature is due to an age spread, or not, by fitting the star formation histories to the red clump regions. However, we find that the width of the extended main sequence turn-off feature is correlated with the age of the clusters in a way which would be unexplained in the age spread interpretation, but which may be expected if stellar rotation is the cause of the spread at the turn-off.