We present photometric ISO 60 and 170um measurements, complemented by some IRAS data at 60um, of a sample of 84 nearby main-sequence stars of spectral class A, F, G and K in order to determine the incidence of dust disks around such main-sequence stars. Of the stars younger than 400 Myr one in two has a disk; for the older stars this is true for only one in ten. We conclude that most stars arrive on the main sequence surrounded by a disk; this disk then decays in about 400 Myr. Because (i) the dust particles disappear and must be replenished on a much shorter time scale and (ii) the collision of planetesimals is a good source of new dust, we suggest that the rapid decay of the disks is caused by the destruction and escape of planetesimals. We suggest that the dissipation of the disk is related to the heavy bombardment phase in our Solar System. Whether all stars arrive on the main sequence surrounded by a disk cannot be established: some very young stars do not have a disk. And not all stars destroy their disk in a similar way: some stars as old as the Sun still have significant disks.