This Astro-2020 White Paper deals with what we might learn from future gravitational wave observations about the early universe phase transitions and their energy scales, primordial black holes, Hubble parameter, dark matter and dark energy, modified theories of gravity and extra dimensions.