We calculated the broad-band photometric evolution of unresolved star clusters, including the preferential loss of low-mass stars due to mass segregation. The stellar mass function of a cluster evolves due to three effects: (a) the evolution of massive stars; (b) early tidal effects reduce the mass function independently of the stellar mass; (c) after mass segregation has completed, tidal effects preferentially remove the lowest-mass stars from the cluster. Results: (1) During the first ~40% of the lifetime of a cluster the cluster simply gets fainter due to the loss of stars by tidal effects. (2) Between ~40 and ~80% of its lifetime the cluster gets bluer due to the loss of low-mass stars. This will result in an underestimate of the age of clusters if standard cluster evolution models are used (0.15 -- 0.5 dex). (3) After ~80% of the total lifetime of a cluster it will rapidly get redder. This is because stars at the low-mass end of the main sequence, which are preferentially lost, are bluer than the AGB stars that dominate the light at long wavelengths, resulting in an age overestimate. (4) Clusters with mass segregation and the preferential loss of low-mass stars evolve along almost the same tracks in colour-colour diagrams as clusters without mass segregation. Therefore it will be difficult to distinguish this effect from that due to the cluster age for unresolved clusters, unless the total lifetime of the clusters can be estimated. (5) The changes in the colour evolution of unresolved clusters due to the preferential loss of low-mass stars will affect the determination of the SFHs. (6) The preferential loss of low-mass stars might explain the presence of old (~13 Gyr) clusters in NGC 4365 which are photometrically disguised as intermediate-age clusters (2 - 5 Gyr). [Abridged]