We summarize what large surveys of the contemporary universe have taught us about the physics and phenomenology of the processes that link the formation and evolution of galaxies and their central supermassive black holes. We present a picture in which the population of AGN can be divided into two distinct populations. The Radiative-Mode AGN are associated with black holes that produce radiant energy powered by accretion at rates in excess of ~1% of the Eddington Limit. They are primarily associated with less massive black holes growing in high-density pseudo-bulges at a rate sufficient to produce the total mass budget in these black holes in ~10 Gyr. The circum-nuclear environment contains high density cold gas and associated star-formation. Major mergers are not the primary mechanism for transporting this gas inward; secular processes appear dominant. Stellar feedback will be generic in these objects and strong AGN feedback is seen only in the most powerful AGN. In Jet-Mode AGN the bulk of energetic output takes the form of collimated outflows (jets). These AGN are associated with the more massive black holes in more massive (classical) bulges and elliptical galaxies. Neither the accretion onto these black holes nor star-formation in their host bulge is significant today. These AGN are probably fueled by the accretion of slowly cooling hot gas that is limited by the feedback/heating provided by AGN radio sources. Surveys of the high-redshift universe are painting a similar picture. (Abridged).