We investigate the distribution of particle acceleration sites, independently of the actual acceleration mechanism, during plasmoid-dominated, relativistic collisionless magnetic reconnection by analyzing the results of a particle-in-cell numerical simulation. The simulation is initiated with Harris-type current layers in pair plasma with no guide magnetic field, negligible radiative losses, no initial perturbation, and using periodic boundary conditions. We find that the plasmoids develop a robust internal structure, with colder dense cores and hotter outer shells, that is recovered after each plasmoid merger on a dynamical time scale. We use spacetime diagrams of the reconnection layers to probe the evolution of plasmoids, and in this context we investigate the individual particle histories for a representative sample of energetic electrons. We distinguish three classes of particle acceleration sites associated with (1) magnetic X-points, (2) regions between merging plasmoids, and (3) the trailing edges of accelerating plasmoids. We evaluate the contribution of each class of acceleration sites to the final energy distribution of energetic electrons -- magnetic X-points dominate at moderate energies, and the regions between merging plasmoids dominate at higher energies. We also identify the dominant acceleration scenarios, in order of decreasing importance -- (1) single acceleration between merging plasmoids, (2) single acceleration at a magnetic X-point, and (3) acceleration at a magnetic X-point followed by acceleration in a plasmoid. Particle acceleration is absent only in the vicinity of stationary plasmoids. The effect of magnetic mirrors due to plasmoid contraction does not appear to be significant in relativistic reconnection.