The high- and intermediate-velocity interstellar clouds (HVCs/IVCs) are tracers of energetic processes in and around the Milky Way. Clouds with near-solar metallicity about one kpc above the disk trace the circulation of material between disk and halo (the Galactic Fountain). The Magellanic Stream consists of gas tidally extracted from the SMC, tracing the dark matter potential of the Milky Way. Several other HVCs have low-metallicity and appear to trace the continuing accretion of infalling intergalactic gas. These assertions are supported by the metallicities (0.1 to 1 solar) measured for about ten clouds in the past decade. Direct measurements of distances to HVCs have remained elusive, however. In this paper we present four new distance brackets, using VLT observations of interstellar CaII H and K absorption toward distant Galactic halo stars. We derive distance brackets of 5.0 to 11.7 kpc for the Cohen Stream (likely to be an infalling low-metallicity cloud), 9.8 to 15.1 kpc for complex GCP (also known as the Smith Cloud or HVC40-15+100 and with still unknown origin), 1.0 to 2.7 kpc for an IVC that appears associated with the return flow of the Fountain in the Perseus Arm, and 1.8 to 3.8 kpc for cloud g1, which appears to be in the outflow phase of the Fountain. Our measurements further demonstrate that the Milky Way is accreting substantial amounts of gaseous material, which influences the Galaxys current and future dynamical and chemical evolution.