The dynamics, energetics and evolution of pulsar wind nebulae (PWNe) and supernova remnants (SNRs), are strongly affected by their magnetic field strength and distribution. They are usually strong, extended, sources of non-thermal X-ray radiation, producing intrinsically polarised radiation. The energetic wind around pulsars produces a highly-magnetised, structured flow, often displaying a jet and a torus and different features (i.e. wisps, knots). This magnetic-dominant wind evolves as it moves away from the pulsar magnetosphere to the surrounding large-scale nebula, becoming kinetic-dominant. Basic aspects such how this conversion is produced, or how the jets and torus are formed, as well as the level of turbulence in the nebula are still unknown. Likewise, the processes ruling the acceleration of particles in shell-like SNRs up to 1e15 eV, including the amplification of the magnetic field, are not clear yet. Imaging polarimetry in this regard is crucial to localise the regions of shock acceleration and to measure the strength and the orientation of the magnetic field at these emission sites. X-ray polarimetry with the X-ray Imaging Polarimetry Explorer (XIPE) will allow the understanding of the magnetic field structure and intensity on different regions in SNRs and PWNe, helping to unveil long-standing questions such as i.e. acceleration of cosmic rays in SNRs or magnetic-to-kinetic energy transfer. SNRs and PWNe also represent the largest population of Galactic very-high energy gamma-ray sources, therefore the study of their magnetic distribution with XIPE will provide fundamental ingredients on the investigation of those sources at very high energies. We will discuss the physics case related to SNRs and PWNe and the expectations of the XIPE observations of some of the most prominent SNRs and PWNe.